-- Logs begin at Mon 2022-10-17 03:51:00 UTC, end at Mon 2022-10-17 04:50:55 UTC. -- Oct 17 04:22:36.572058 dv-cinder-861557-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 04:22:36.580724 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 04:22:36.584139 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 04:22:36 2022] *** Oct 17 04:22:36.584139 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 04:22:36.584139 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 04:22:36.584139 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: nodename: dv-cinder-861557-1-iscsi Oct 17 04:22:36.584139 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: machine: x86_64 Oct 17 04:22:36.584139 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: clock source: unix Oct 17 04:22:36.584139 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: pcre jit disabled Oct 17 04:22:36.584139 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: detected number of CPU cores: 4 Oct 17 04:22:36.584139 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: current working directory: / Oct 17 04:22:36.584139 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: detected binary path: /usr/bin/uwsgi-core Oct 17 04:22:36.584139 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: your processes number limit is 47680 Oct 17 04:22:36.584139 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: your memory page size is 4096 bytes Oct 17 04:22:36.584139 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: detected max file descriptor number: 2048 Oct 17 04:22:36.584139 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: lock engine: pthread robust mutexes Oct 17 04:22:36.584139 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: thunder lock: enabled Oct 17 04:22:36.584139 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 04:22:36.587129 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 04:22:36.624350 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: Python main interpreter initialized at 0x55753b9359c0 Oct 17 04:22:36.624350 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: python threads support enabled Oct 17 04:22:36.624350 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: your server socket listen backlog is limited to 100 connections Oct 17 04:22:36.624350 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: your mercy for graceful operations on workers is 90 seconds Oct 17 04:22:36.624745 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 04:22:36.624745 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: *** Operational MODE: preforking *** Oct 17 04:22:36.625010 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: *** uWSGI is running in multiple interpreter mode *** Oct 17 04:22:36.625010 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: spawned uWSGI master process (pid: 103704) Oct 17 04:22:36.625229 dv-cinder-861557-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 17 04:22:36.629114 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: spawned uWSGI worker 1 (pid: 103705, cores: 1) Oct 17 04:22:36.629114 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: spawned uWSGI worker 2 (pid: 103706, cores: 1) Oct 17 04:22:36.629114 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 04:22:37.290158 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 04:22:37.300752 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 04:22:38.390900 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 04:22:38.390900 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: from cryptography.utils import int_from_bytes Oct 17 04:22:38.391486 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 04:22:38.391486 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: from cryptography.utils import int_from_bytes Oct 17 04:22:38.391949 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 04:22:38.391949 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: from cryptography.utils import int_from_bytes Oct 17 04:22:38.392093 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 04:22:38.392093 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: from cryptography.utils import int_from_bytes Oct 17 04:22:40.911767 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 04:22:40.912328 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 04:22:40.912494 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 04:22:40.912854 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 04:22:40.912953 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 04:22:40.913035 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 04:22:40.913156 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 04:22:40.913306 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 04:22:40.913526 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.913675 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 04:22:40.913852 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.913950 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 04:22:40.914176 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.914311 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.914496 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.914643 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.914826 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.914975 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.915140 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.915300 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.915460 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.915637 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.915780 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.915955 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.916108 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.916281 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.916367 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.916606 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.916692 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.916938 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.917038 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861557-1-iscsi {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.917231 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.917333 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.917584 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.917731 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.918046 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.918138 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861557-1-iscsi {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.918366 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.918460 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.918673 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.918758 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.918988 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.919073 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.919295 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.919379 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.919608 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.919788 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.919935 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.920237 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.920339 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.920545 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.920737 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.920855 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.921056 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.921211 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.921390 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.921521 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.921703 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.921834 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.922052 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.922147 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.922362 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.922444 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.922684 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.922800 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.923003 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.923103 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.923315 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.923461 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861557-1-iscsi {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.923642 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.923736 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.923956 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.924055 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.924337 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.924422 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861557-1-iscsi {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.924661 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.924746 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.924981 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.925068 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.925337 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.925431 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.925679 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.925778 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.926012 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.926098 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.926322 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.926416 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.926651 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.926737 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.926972 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.927070 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.927284 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.927377 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.927604 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.927688 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.927909 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.927995 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.928220 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.928315 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.928532 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.928619 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.928853 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.928946 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.929182 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.929283 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.929491 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.929585 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.929743 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.929828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.930054 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.930140 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.930377 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.930470 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.930651 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.930737 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.930968 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.931055 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.931253 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.931339 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.931504 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.931599 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.931825 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.931920 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.932148 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.932290 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.932412 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.932507 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.932736 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.932822 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.933584 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.933738 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.933894 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.934145 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.934231 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.934470 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.934555 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.934791 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.934996 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.935103 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.935239 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.935414 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.935510 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.935724 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.935819 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.936037 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.936129 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.936344 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.936436 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.936664 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.936758 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.936981 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.937065 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.937321 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.937406 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.937632 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.937718 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.937958 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.938044 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.938277 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.938362 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.938589 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.938677 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.938910 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.938996 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.939231 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.939326 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.939542 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.939688 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.939850 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.939939 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.940160 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.940247 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.940480 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.940566 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.940793 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.940878 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.941133 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.941237 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.941395 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.941481 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.941699 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.941785 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.942008 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.942103 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.942327 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.942414 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.942617 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.942708 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.942926 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.943021 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.943234 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.943326 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.943540 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.943658 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.943852 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.943960 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.944159 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.944246 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.944466 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.944553 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.944770 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.944856 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.945090 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.945177 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.945405 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.945490 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.945709 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.945796 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.946015 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.946101 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.946321 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.946406 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.946627 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.946714 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.946935 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.947020 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.947247 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.947348 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.947553 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.947639 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.947859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.947943 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.948164 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.948253 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.948469 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.948557 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.949656 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.949807 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.949968 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.950131 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.950278 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.950450 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.950599 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.950768 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.950907 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.951098 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.951212 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.951413 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.951533 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.951733 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.951841 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.952061 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.952156 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.952374 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.952462 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.952686 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.952772 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.953010 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.953128 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.953352 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.953438 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.953661 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.953767 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.953970 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.954068 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.954273 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.954369 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.954577 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.954671 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.954881 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.954977 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.955185 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.955271 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.955487 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.955621 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.955791 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.955885 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.956089 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.956174 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.956396 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.956489 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.956706 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.956794 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.957012 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.957162 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.957344 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.957448 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.957646 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.957731 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.957963 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.958095 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.958285 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.958389 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.958599 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.958685 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.958911 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.959005 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.959223 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.959322 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.959547 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:22:40.959633 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.959885 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.959970 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.960203 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.960289 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.960520 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.960618 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.960841 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.960927 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.961196 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.961288 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.961514 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.961610 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.961831 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.961917 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.962146 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.962233 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.962469 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.962562 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.962790 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.962883 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.963107 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.963194 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.963427 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.963523 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.963748 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.963850 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.964074 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.964172 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.964431 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.964530 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.964844 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.964946 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.965088 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.965177 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.965419 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.965518 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.965731 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.965831 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.966047 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.966132 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.966371 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.966457 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.966706 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.966801 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.967029 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.967115 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.967347 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.967432 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.967660 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.967754 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.967976 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.968063 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.968292 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.968378 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.968637 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.968732 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.968954 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.969040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.969301 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.969398 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.969621 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.969710 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.969937 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.970030 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.970262 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.970348 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.970580 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.970667 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.970894 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.971027 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.971214 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.971301 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.971529 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.971616 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.971844 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.971939 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.972164 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.972249 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.972482 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.972579 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.972803 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.972889 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.973140 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.973228 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.973458 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.973544 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.973776 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.973875 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.974095 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.974207 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.974407 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.974501 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.974722 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.974816 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.975031 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.975129 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.975340 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.975426 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.975648 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.975733 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.975963 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.976066 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.976272 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.976370 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.976583 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.976675 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.976897 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.976993 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.977232 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.977322 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.977549 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.977635 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.977860 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.977956 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.978188 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.978274 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.978513 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.978605 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.978825 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.978911 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.979131 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.979218 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.979448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.979534 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.979763 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.979887 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.980166 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.980292 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.980481 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.980557 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.980796 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.980883 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.981125 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.981215 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.981457 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.981557 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.981767 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.981855 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.982076 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.982162 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.982392 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.982493 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.982705 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.982791 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.983018 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.983102 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.983332 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.983426 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.983642 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.983727 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.983961 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.984053 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.984273 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.984417 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.984586 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.984674 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.984905 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.984999 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.985247 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.985336 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.985560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.985646 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.985884 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.985977 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.986203 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.986292 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.986519 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.986605 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.986827 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.986916 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.987139 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.987226 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.987444 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.987537 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.987750 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.987836 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.988054 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.988142 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.988366 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.988452 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.988670 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.988764 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.988972 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.989067 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.989311 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.989397 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.989617 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.989715 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.989923 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.990018 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.990230 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.990322 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.990539 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.990633 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.990841 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.990927 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.991146 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.991238 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.991452 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.991546 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.991779 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.991874 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.992088 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.992174 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.992395 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.992481 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.992703 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.992790 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.993010 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.993116 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.993382 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.993478 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.993695 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.993788 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.994009 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.994094 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.994321 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.994407 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.994633 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.994718 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.994946 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.995032 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.995259 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.995346 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.996106 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.996209 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.996420 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.996515 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.996742 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.996828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.997054 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.997225 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.997399 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.997496 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.997711 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.997806 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.998032 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.998119 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.998340 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.998434 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.998655 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.998763 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.998992 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.999089 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.999306 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.999400 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.999629 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.999718 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:40.999938 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.000023 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.000251 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.000346 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.000568 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.000662 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.000879 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.000966 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.001226 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.001318 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.001542 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.001692 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.001860 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.001947 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.002180 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.002276 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.002492 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.002577 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.002810 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.002896 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.003118 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.003205 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.003431 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.003560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.003741 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.003827 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.004058 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.004145 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.004362 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.004447 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.004677 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.004766 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.005001 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.005119 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.005359 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.005447 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.005668 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.005764 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.005978 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.006064 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.006297 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.006383 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.006605 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.006699 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.006917 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.007003 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.007227 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.007314 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.007533 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.007629 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.007839 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.007925 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.008148 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.008233 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.008461 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.008557 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.008771 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.008857 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.009126 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.009217 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.009406 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.009493 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.009717 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.009809 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.010024 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.010173 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.010328 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.010423 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.010630 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.010729 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.010936 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.011022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.011330 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.011428 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.011650 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.011736 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.011974 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.012060 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.012297 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.012385 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.012603 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.012690 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.012909 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.013004 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.013255 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.013344 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.013570 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.013659 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.013876 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.013983 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.014182 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.014269 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.014487 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.014573 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.014828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.014931 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.015137 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.015222 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.015443 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.015529 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.015752 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.015911 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.016063 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.016158 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.016372 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.016460 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.016686 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.016774 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.016997 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.017104 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.017332 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.017419 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.017656 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.017743 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.017970 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.018055 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.018282 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.018368 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.018595 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.018681 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.018906 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.019037 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.019217 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.019304 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.019528 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.019615 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.019840 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.019925 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.020150 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.020244 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.020464 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.020549 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.020773 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.020858 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.021096 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.021199 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.021415 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.021502 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.021734 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.021819 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.022051 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.022304 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.022391 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.022645 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.022731 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.022967 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.023053 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.023288 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.023374 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.023635 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.023854 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.023954 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.024191 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.024278 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.024516 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.024648 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.024842 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.024931 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.025217 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.025329 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.025536 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.025632 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.025846 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.025933 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.026153 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.026239 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.026467 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.026566 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.027316 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.027414 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.027626 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.027713 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.027934 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.028021 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.028241 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.028327 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.028548 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.028633 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.028855 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.028940 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.029189 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.029279 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.029501 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.029587 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.029813 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.029900 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.030121 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.030207 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.030428 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.030520 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.030733 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.030819 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.031038 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.031123 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.031358 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.031453 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.031664 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.031750 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.031971 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.032057 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.032284 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.032379 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.032610 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.032710 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.032924 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.033009 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.033267 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.033367 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.033580 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.033667 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.033889 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.033976 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.034226 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.034320 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.034534 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.034620 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.034877 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.034973 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.035165 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.035253 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.035471 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.035566 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.035778 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.035871 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.036089 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.036231 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.036398 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.036486 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.036703 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.036798 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.037016 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.037153 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.037349 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.037434 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.037658 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.037742 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.037971 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.038058 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.038274 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.038360 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.038585 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.038731 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.038915 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.039001 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.039205 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.039291 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.039511 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.039609 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.039816 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.039909 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.040131 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.040257 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.040425 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.040591 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.040733 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.040828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.041038 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.041158 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.041369 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.041468 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.041671 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.041756 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.041982 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.042077 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.042315 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.042412 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.042726 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.042856 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.043044 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.043143 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.043352 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.043441 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.043674 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.043761 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.043984 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.044072 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.044293 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.044381 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.044601 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.044687 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.044913 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.045013 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.045252 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.045343 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.045560 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.045648 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.045866 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.045960 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.046173 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.046261 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.046481 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.046618 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.046791 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.046887 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.047103 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.047190 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.047407 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.047493 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.047713 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.047807 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.048017 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.048103 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.048323 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.048409 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.048629 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.048723 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.048940 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.049025 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.049266 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.049365 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.049572 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.049660 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.049875 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.049962 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.050181 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.050273 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.050483 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.050570 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.050786 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.050873 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.051093 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.051187 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.051397 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.051483 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.051700 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.051785 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.052003 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.052088 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.052332 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.052419 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.052644 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.052729 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.052950 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.053049 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.053293 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.053396 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.053601 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.053689 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.053937 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.054076 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.054243 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.054329 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.054553 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.054648 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.054867 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.054962 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.055174 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.055261 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.055491 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.055577 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.055804 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.055900 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.056118 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.056203 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.056423 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.056507 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.056729 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.056822 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.057045 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.057171 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.057381 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.057468 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.057696 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.057789 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.058530 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.058627 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.058838 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.058933 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.059163 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.059290 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.059480 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.059575 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.059795 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.059882 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.060121 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.060209 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.060431 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.060517 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.060745 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.060841 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.061055 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.061162 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.061391 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.061477 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.061704 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.061806 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.062018 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.062105 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.062329 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.062414 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.062648 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.062746 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.062955 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.063041 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.063268 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.063354 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.063579 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.063674 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.063886 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.063972 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.064198 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.064283 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.064509 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.064604 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.064812 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.064897 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.065145 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.065235 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.065458 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.065546 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.065768 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.065853 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.066075 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.066161 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.066380 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.066506 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.066694 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.066826 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.067002 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.067143 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.067320 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.067454 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.067627 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.067770 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.068054 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.068150 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.068370 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.068456 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.068686 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.068773 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.068994 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.069133 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.069335 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.069421 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.069652 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.069749 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.069973 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.070137 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.070293 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.070380 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.070603 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.070697 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.070921 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.071015 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.071237 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.071327 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.071564 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.071651 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.071872 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.071969 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.072178 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.072265 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.072487 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.072582 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.072818 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.072905 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.073146 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.073236 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.073473 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.073904 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.074094 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.074228 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.074407 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.074711 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.074805 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.075024 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.075168 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.075349 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.075442 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.075747 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.075833 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.076064 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.076151 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.076376 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.076468 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.076705 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.076819 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.077035 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.077181 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.077368 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.077465 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.077688 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.077775 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.078003 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.078089 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.078332 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.078419 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.078661 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.078750 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.078980 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.079078 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.079297 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.079383 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.079604 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.079694 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.079931 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.080018 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.080247 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.080334 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.080563 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.080648 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.080874 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.080960 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.081230 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.081322 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.081560 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.081647 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.081881 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.081978 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.082211 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.082298 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.082554 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.082647 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.082869 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.082965 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.083178 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.083273 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.083490 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.083578 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.083800 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.083897 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.084108 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.084195 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.084433 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.084530 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.084742 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.084831 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.085058 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.085234 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.085391 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.085478 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.085702 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.085789 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.086010 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.086096 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.086317 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.086404 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.086632 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.086719 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.086937 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.087024 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.087244 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.087336 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.087551 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.087649 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.087876 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.087961 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.088184 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.088270 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.088489 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.088575 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.088815 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.088901 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.089150 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.089813 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.090006 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.090204 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.090316 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.090523 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.090646 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.090833 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.090960 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.091179 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.091267 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.091491 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.091579 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.091814 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.091901 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.092147 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.092232 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.092479 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.092574 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.092793 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.092892 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.093155 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.093244 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.093491 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.093590 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.093807 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.093893 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.094121 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.094206 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.094442 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.094539 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.094768 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.094855 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.095076 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.095162 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.095385 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.095481 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.095699 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.095787 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.096006 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.096099 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.096312 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.096407 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.096618 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.096705 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.096927 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.097020 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.097254 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.097342 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.097558 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.097645 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.097864 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.097950 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.098172 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.098259 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.098480 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.098566 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.098791 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.098880 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.099102 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.099188 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.099411 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.099507 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.099718 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.099818 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.100024 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.100111 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.100336 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.100423 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.100648 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.100742 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.100958 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.101044 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.101299 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.101389 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.101627 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.101726 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.101945 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.102038 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.102259 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.102352 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.102575 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.102670 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.102893 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.102979 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.103209 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.103297 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.103528 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.103615 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.103841 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.103926 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.104152 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.104238 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.104472 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.104558 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.104815 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.104915 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.105214 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.105356 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.105542 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.105842 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.105930 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.106170 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.106256 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.106485 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.106698 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.106786 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.107038 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.107125 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.107360 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.107455 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.107682 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.107769 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.108001 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.108087 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.108312 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.108406 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.108626 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.108713 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.108939 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.109026 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.109280 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.109381 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.109599 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.109686 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.109916 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.110002 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.110250 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.110338 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.110565 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.110651 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.110884 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.110970 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.111203 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.111293 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.111520 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.111606 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.111841 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.111926 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.112163 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.112251 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.112474 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.112567 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.112798 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.112897 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.113125 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.113216 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.113444 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.113532 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.113764 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.113926 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.114080 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.114175 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.114397 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.114484 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.114711 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.114798 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.115024 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.115110 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.115334 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.115419 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.115651 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.115747 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.115965 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.116057 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.116278 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.116363 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.116595 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.116683 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.116913 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.117000 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.117250 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.117350 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.117569 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.117656 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.117885 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.117976 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.118207 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.118409 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.118527 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.118725 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.118859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.119063 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.119361 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.119487 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.119681 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.119804 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.120010 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.120133 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.120330 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.120959 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.121197 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.121322 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.121559 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.121672 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.121881 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.121998 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.122193 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.122307 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.122508 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.122623 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.122816 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.122939 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.123130 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.123245 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.123440 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.123553 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.123747 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.123863 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.124521 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.124614 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.124614 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.124785 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.124785 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.124953 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.125035 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.125258 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.125360 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.125577 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.125824 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.125911 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.126173 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.126260 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.126493 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.126582 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.126816 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.126915 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.127140 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.127275 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.127450 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.127551 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.127758 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.127852 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.128075 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.128175 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.128383 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.128469 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.128688 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.128772 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.128995 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.129122 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.129331 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.129419 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.129639 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.129724 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.129943 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.130048 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.130258 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.130344 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.130562 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.130655 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.130869 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.130964 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.131186 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.131281 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.131741 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.131876 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.131995 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.132110 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.132217 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.132331 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.132443 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.132550 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.132688 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.132806 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.132996 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.133138 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.133328 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.133443 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.133643 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.133759 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.133952 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.134065 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.134258 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.134372 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.134564 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.134687 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.134871 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.134984 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.135184 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.135299 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.135494 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.135618 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.135811 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.135925 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.136223 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.136355 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.136541 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.136703 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.136847 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.136961 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.137201 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.137317 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.137514 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.137602 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.137826 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.137912 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.138147 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.138243 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.138462 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.138549 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.138789 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.138877 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.139105 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.139201 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.139421 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.139645 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.139770 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.139986 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.140081 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.140312 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.140623 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.140711 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.140964 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.141050 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.141285 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.141405 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.141594 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.141683 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.141904 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.141991 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.142234 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.142322 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.142548 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.142635 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.142863 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.142964 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.143178 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.143265 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.143492 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.143578 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.143804 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.143899 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.144117 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.144210 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.144427 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.144513 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.144740 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.144835 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.145051 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.145191 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.145383 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.145470 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.145694 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.145782 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.146003 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.146088 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.146314 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.146401 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.146624 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.146712 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.146935 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.147022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.147252 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.147342 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.147567 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.147655 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.147885 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.147979 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.148200 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.148294 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.148521 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.148608 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.148834 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.148921 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.149168 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.149285 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.149482 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.149578 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.149794 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.149881 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.150106 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.150202 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.150420 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.150507 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.150733 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.150828 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.151040 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.151135 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.151374 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.152229 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.152330 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.152571 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.152680 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.152895 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.153249 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.153392 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.153567 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.153722 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.153894 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.154061 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.154219 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.154396 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.154542 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.154717 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.154868 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.155049 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.155180 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.155380 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.155515 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.155701 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.155856 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.156028 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.156186 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.156346 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.156513 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.156682 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.156824 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.157026 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.157162 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.157405 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.157492 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.157737 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.157826 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.158051 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.158138 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.158363 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.158465 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.158668 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.158754 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.158975 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.159062 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.159287 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.159382 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.159592 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.159679 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.159898 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.159985 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.160206 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.160301 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.160509 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.160596 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.160815 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.160909 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.161141 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.161249 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.161449 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.161591 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.161754 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.161889 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.162060 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.162150 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.162365 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.162458 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.162668 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.162755 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.162974 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.163061 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.163277 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.163363 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.163580 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.163666 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.163881 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.163967 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.164186 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.164272 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.164492 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.164577 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.164801 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.164896 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.165133 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.165223 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.165444 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.165543 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.165752 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.165850 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.166083 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.166169 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.166406 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.166501 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.166717 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.166804 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.167038 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.167125 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.167467 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.167572 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.167785 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.167967 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.168098 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.168295 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.168431 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.168625 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.168743 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.168955 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.169042 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.169303 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.169405 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.169621 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.169708 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.169959 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.170046 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.170275 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.170370 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.170592 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.170678 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.170907 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.171001 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.171215 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.171378 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.171528 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.171656 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.171843 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.171940 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.172162 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.172249 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.172480 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.172566 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.172787 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.172872 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.173138 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.173237 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.173456 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.173541 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.173770 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.173866 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.174083 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.174170 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.174400 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.174484 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.174710 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.174804 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.175030 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.175117 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.175342 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.175436 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.175655 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.175751 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.175969 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.176062 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.176283 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.176369 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.176601 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.176701 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.176919 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.177014 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.177253 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.177353 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.177571 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.177658 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.177890 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.177976 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.178219 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.178314 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.178535 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.178622 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.178851 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.178936 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.179181 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.179267 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.179495 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.179581 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.179809 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.179896 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.180116 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.180204 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.180359 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 04:22:41.180460 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.180794 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.181134 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.181454 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.181764 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:22:41.182009 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 04:22:41.334733 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO dbcounter [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] Registered counter for database nova_api Oct 17 04:22:41.335007 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO dbcounter [None req-4de23abf-e6e6-4c85-ab51-3c3570e544d9 None None] Registered counter for database nova_api Oct 17 04:22:41.355583 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG oslo_db.sqlalchemy.engines [None req-4de23abf-e6e6-4c85-ab51-3c3570e544d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 04:22:41.358822 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_db.sqlalchemy.engines [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 04:22:41.362222 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writer thread running {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 04:22:41.365339 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writer thread running {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 04:22:41.419211 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.context [None req-4de23abf-e6e6-4c85-ab51-3c3570e544d9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfb5b667-bbe0-47ae-a932-3b61872d8f9d(cell1) {{(pid=103705) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 04:22:41.423036 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-4de23abf-e6e6-4c85-ab51-3c3570e544d9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:22:41.423149 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.context [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfb5b667-bbe0-47ae-a932-3b61872d8f9d(cell1) {{(pid=103706) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 04:22:41.423513 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-4de23abf-e6e6-4c85-ab51-3c3570e544d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:22:41.425152 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-4de23abf-e6e6-4c85-ab51-3c3570e544d9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:22:41.425890 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-4de23abf-e6e6-4c85-ab51-3c3570e544d9 None None] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:22:41.426338 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-4de23abf-e6e6-4c85-ab51-3c3570e544d9 None None] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:22:41.427068 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:22:41.427541 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:22:41.428330 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG oslo_concurrency.lockutils [None req-4de23abf-e6e6-4c85-ab51-3c3570e544d9 None None] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:22:41.429110 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:22:41.429844 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:22:41.430292 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:22:41.430382 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO dbcounter [None req-4de23abf-e6e6-4c85-ab51-3c3570e544d9 None None] Registered counter for database nova_cell0 Oct 17 04:22:41.432298 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:22:41.434327 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO dbcounter [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] Registered counter for database nova_cell0 Oct 17 04:22:41.434574 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO dbcounter [None req-4de23abf-e6e6-4c85-ab51-3c3570e544d9 None None] Registered counter for database nova_cell1 Oct 17 04:22:41.438251 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO dbcounter [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] Registered counter for database nova_cell1 Oct 17 04:22:41.442555 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG oslo_db.sqlalchemy.engines [None req-4de23abf-e6e6-4c85-ab51-3c3570e544d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 04:22:41.444721 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG oslo_db.sqlalchemy.engines [None req-4de23abf-e6e6-4c85-ab51-3c3570e544d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 04:22:41.447681 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_db.sqlalchemy.engines [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 04:22:41.449515 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_db.sqlalchemy.engines [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 04:22:41.450075 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writer thread running {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 04:22:41.453204 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writer thread running {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 04:22:41.455949 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writer thread running {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 04:22:41.457424 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writer thread running {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 04:22:41.599510 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO dbcounter [None req-4de23abf-e6e6-4c85-ab51-3c3570e544d9 None None] Registered counter for database nova_cell0 Oct 17 04:22:41.602901 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO dbcounter [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] Registered counter for database nova_cell0 Oct 17 04:22:41.607390 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG oslo_db.sqlalchemy.engines [None req-4de23abf-e6e6-4c85-ab51-3c3570e544d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 04:22:41.612098 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writer thread running {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 04:22:41.612332 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_db.sqlalchemy.engines [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 04:22:41.617045 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writer thread running {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 04:22:41.951633 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: WARNING keystonemiddleware.auth_token [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 04:22:41.955178 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: WARNING keystonemiddleware.auth_token [None req-4de23abf-e6e6-4c85-ab51-3c3570e544d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 04:22:41.958985 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: WARNING keystonemiddleware.auth_token [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 04:22:41.962420 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: WARNING keystonemiddleware.auth_token [None req-4de23abf-e6e6-4c85-ab51-3c3570e544d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 04:22:42.302169 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: WARNING keystonemiddleware.auth_token [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 04:22:42.306639 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: WARNING keystonemiddleware.auth_token [None req-4de23abf-e6e6-4c85-ab51-3c3570e544d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 04:22:42.308177 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: WARNING keystonemiddleware.auth_token [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 04:22:42.312652 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: WARNING keystonemiddleware.auth_token [None req-4de23abf-e6e6-4c85-ab51-3c3570e544d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 04:22:42.313498 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55753b9359c0 pid: 103706 (default app) Oct 17 04:22:42.315558 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:22:42.316763 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001749 Oct 17 04:22:42.317202 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Mon Oct 17 04:22:42 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:22:42.318168 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55753b9359c0 pid: 103705 (default app) Oct 17 04:24:03.767953 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:03.768868 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Oct 17 04:24:03.769287 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 931 bytes} [Mon Oct 17 04:24:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:24:03.783238 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writing DB stats nova_api:SELECT=3 {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:24:03.784354 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writing DB stats nova_cell0:SELECT=3 {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:24:03.785211 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writing DB stats nova_cell1:SELECT=3 {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:24:03.786515 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:24:04.668550 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-e0d9bf7f-f471-4df0-aedf-c4c113713df2 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:04.702043 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-e0d9bf7f-f471-4df0-aedf-c4c113713df2 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.925649 Oct 17 04:24:04.705148 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1292 bytes} [Mon Oct 17 04:24:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:24:07.328563 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:07.330018 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-a4e4e0f0-51dc-4220-aef7-c53b95ec1c0b None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001868 Oct 17 04:24:07.330721 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 931 bytes} [Mon Oct 17 04:24:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:24:07.780063 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-8a09dcfd-f658-4935-80f1-90c23c1a471e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "id": "c1"}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:07.827950 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-8a09dcfd-f658-4935-80f1-90c23c1a471e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.490948 Oct 17 04:24:07.828555 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Oct 17 04:24:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 04:24:07.843304 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_api:SELECT=3 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:24:07.845396 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_cell0:SELECT=3 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:24:07.846123 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_cell1:SELECT=3 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:24:07.847105 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:24:08.050921 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-02040f51-857f-4b9a-8763-01bd3dbabfa1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:08.120883 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-02040f51-857f-4b9a-8763-01bd3dbabfa1 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283052 Oct 17 04:24:08.121495 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1336 bytes} [Mon Oct 17 04:24:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:24:10.766814 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-8a09dcfd-f658-4935-80f1-90c23c1a471e admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:10.767756 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-8a09dcfd-f658-4935-80f1-90c23c1a471e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Oct 17 04:24:10.768160 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 931 bytes} [Mon Oct 17 04:24:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:24:11.431500 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-7e077d2b-66cd-49a9-8d23-21f79fb08aa2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 5, "ram": 512, "vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:11.475334 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-7e077d2b-66cd-49a9-8d23-21f79fb08aa2 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.699923 Oct 17 04:24:11.476012 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Oct 17 04:24:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 04:24:11.488024 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-f0e1a9e3-88af-4427-aeb0-c382ad1c3fd9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:11.532432 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-f0e1a9e3-88af-4427-aeb0-c382ad1c3fd9 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048237 Oct 17 04:24:11.533359 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1336 bytes} [Mon Oct 17 04:24:11 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:24:14.135823 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-7e077d2b-66cd-49a9-8d23-21f79fb08aa2 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:14.136923 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-7e077d2b-66cd-49a9-8d23-21f79fb08aa2 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Oct 17 04:24:14.137400 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 931 bytes} [Mon Oct 17 04:24:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:24:14.554201 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-d439b5e9-a44d-49ed-b51e-0d5148790311 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10, "os-flavor-access:is_public": true, "id": "d2", "swap": 0, "name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:14.575176 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-d439b5e9-a44d-49ed-b51e-0d5148790311 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430578 Oct 17 04:24:14.575536 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Oct 17 04:24:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 04:24:14.588734 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-82e8db16-4173-4348-9812-5b9696a4d6c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:14.619615 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-82e8db16-4173-4348-9812-5b9696a4d6c0 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035295 Oct 17 04:24:14.620379 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1336 bytes} [Mon Oct 17 04:24:14 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:24:17.285567 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-d439b5e9-a44d-49ed-b51e-0d5148790311 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:17.286576 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-d439b5e9-a44d-49ed-b51e-0d5148790311 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 17 04:24:17.286976 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 931 bytes} [Mon Oct 17 04:24:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:24:17.701762 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-fb8dfb77-0ab4-46e3-bf28-c0e9b22c787e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "id": "d3"}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:17.722267 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-fb8dfb77-0ab4-46e3-bf28-c0e9b22c787e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.428910 Oct 17 04:24:17.725120 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Oct 17 04:24:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 04:24:17.736352 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-8271bb51-c3ee-4f62-86a6-0f89c345aeae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:17.763855 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-8271bb51-c3ee-4f62-86a6-0f89c345aeae admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031673 Oct 17 04:24:17.764603 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1336 bytes} [Mon Oct 17 04:24:17 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:24:20.399555 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-fb8dfb77-0ab4-46e3-bf28-c0e9b22c787e admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:20.400601 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-fb8dfb77-0ab4-46e3-bf28-c0e9b22c787e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002077 Oct 17 04:24:20.401020 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 931 bytes} [Mon Oct 17 04:24:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:24:20.822372 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-d43ee435-effc-4105-8e32-71223cbc3bec admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d4", "ram": 4096, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:20.846736 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-d43ee435-effc-4105-8e32-71223cbc3bec admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437852 Oct 17 04:24:20.847438 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Oct 17 04:24:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 04:24:20.862435 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-751bb456-3d93-4f21-b4b9-2ae7c3af1ef9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:20.886936 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-751bb456-3d93-4f21-b4b9-2ae7c3af1ef9 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028230 Oct 17 04:24:20.887493 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1336 bytes} [Mon Oct 17 04:24:20 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:24:23.535159 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-d43ee435-effc-4105-8e32-71223cbc3bec admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:23.536213 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-d43ee435-effc-4105-8e32-71223cbc3bec admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 17 04:24:23.536697 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 931 bytes} [Mon Oct 17 04:24:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:24:23.955063 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-d8a2d3d1-8d25-401f-9f07-49ce3488f239 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:23.981767 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-d8a2d3d1-8d25-401f-9f07-49ce3488f239 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.437970 Oct 17 04:24:23.982258 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1292 bytes} [Mon Oct 17 04:24:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:24:26.571048 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-d43ee435-effc-4105-8e32-71223cbc3bec admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:26.572090 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-d43ee435-effc-4105-8e32-71223cbc3bec admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002010 Oct 17 04:24:26.572518 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 931 bytes} [Mon Oct 17 04:24:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:24:26.993373 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-f92bf6cc-3759-4d19-83aa-28a9fd428c19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "id": "1", "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:27.016888 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-f92bf6cc-3759-4d19-83aa-28a9fd428c19 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.437849 Oct 17 04:24:27.017775 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Oct 17 04:24:26 2022] POST /compute/v2.1/flavors => generated 402 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 04:24:27.030366 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-e227cd32-9654-46e0-a007-f863dc90e06b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:27.059937 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-e227cd32-9654-46e0-a007-f863dc90e06b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033539 Oct 17 04:24:27.060696 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1333 bytes} [Mon Oct 17 04:24:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:24:29.693577 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-f92bf6cc-3759-4d19-83aa-28a9fd428c19 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:29.694584 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-f92bf6cc-3759-4d19-83aa-28a9fd428c19 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 17 04:24:29.695018 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 931 bytes} [Mon Oct 17 04:24:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:24:30.063623 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-8725a0cb-5c46-4cec-9159-8d474ba26cb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "swap": 0}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:30.082284 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-8725a0cb-5c46-4cec-9159-8d474ba26cb0 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.380745 Oct 17 04:24:30.082948 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Oct 17 04:24:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 04:24:30.094965 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-321cddf5-df26-4bcc-9e79-e3151732aec9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:30.119213 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-321cddf5-df26-4bcc-9e79-e3151732aec9 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027864 Oct 17 04:24:30.119787 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1333 bytes} [Mon Oct 17 04:24:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:24:32.731763 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-8725a0cb-5c46-4cec-9159-8d474ba26cb0 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:32.733476 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-8725a0cb-5c46-4cec-9159-8d474ba26cb0 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002195 Oct 17 04:24:32.733871 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 931 bytes} [Mon Oct 17 04:24:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:24:33.225954 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-de7dbca8-f64a-4343-b732-ed559c051277 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "swap": 0, "ram": 4096, "disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:33.248410 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-de7dbca8-f64a-4343-b732-ed559c051277 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.508486 Oct 17 04:24:33.248961 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Oct 17 04:24:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 04:24:33.262790 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-cf91156a-64e3-4c20-9800-514fb4f6206f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:33.289676 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-cf91156a-64e3-4c20-9800-514fb4f6206f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032481 Oct 17 04:24:33.302074 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1333 bytes} [Mon Oct 17 04:24:33 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:24:35.914535 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-de7dbca8-f64a-4343-b732-ed559c051277 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:35.915542 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-de7dbca8-f64a-4343-b732-ed559c051277 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 17 04:24:35.915932 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 931 bytes} [Mon Oct 17 04:24:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:24:36.374845 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-3b1a2429-95c3-477f-81d5-143d711bac3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large"}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:36.381419 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:24:36.400548 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-3b1a2429-95c3-477f-81d5-143d711bac3e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.478483 Oct 17 04:24:36.401130 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Oct 17 04:24:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 04:24:36.413068 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-2e7eda3a-17ae-4707-8a8e-5578c5669085 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:36.441312 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-2e7eda3a-17ae-4707-8a8e-5578c5669085 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031928 Oct 17 04:24:36.442764 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1333 bytes} [Mon Oct 17 04:24:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:24:39.118304 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-3b1a2429-95c3-477f-81d5-143d711bac3e admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:39.119535 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-3b1a2429-95c3-477f-81d5-143d711bac3e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001803 Oct 17 04:24:39.119936 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 931 bytes} [Mon Oct 17 04:24:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:24:39.580907 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-26918ef5-b0a4-4499-9840-c687c5379a44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5", "disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge"}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:39.588035 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:24:39.615310 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-26918ef5-b0a4-4499-9840-c687c5379a44 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.477751 Oct 17 04:24:39.615310 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1283 bytes} [Mon Oct 17 04:24:39 2022] POST /compute/v2.1/flavors => generated 408 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 04:24:39.621416 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-8656d194-2656-484f-ae5f-dc0396053576 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:24:39.649375 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-8656d194-2656-484f-ae5f-dc0396053576 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032595 Oct 17 04:24:39.649869 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1333 bytes} [Mon Oct 17 04:24:39 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:24:56.830362 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-26918ef5-b0a4-4499-9840-c687c5379a44 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:56.831288 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-26918ef5-b0a4-4499-9840-c687c5379a44 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 17 04:24:56.831680 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 931 bytes} [Mon Oct 17 04:24:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:24:56.843315 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:24:57.222765 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-80ee0e29-3bbe-46f3-a4fb-4968a770cab8 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:57.241558 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-80ee0e29-3bbe-46f3-a4fb-4968a770cab8 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402208 Oct 17 04:24:57.242074 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1292 bytes} [Mon Oct 17 04:24:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:24:58.548322 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-26918ef5-b0a4-4499-9840-c687c5379a44 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:58.549376 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-26918ef5-b0a4-4499-9840-c687c5379a44 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 17 04:24:58.549777 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Oct 17 04:24:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:24:59.068001 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-d26519b3-50ed-457e-9c1f-73af8835d584 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:59.074776 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.wsgi [None req-d26519b3-50ed-457e-9c1f-73af8835d584 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-d26519b3-50ed-457e-9c1f-73af8835d584 admin admin] Request method failure captured: Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Accept: application/json Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Accept-Encoding: gzip, deflate Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Connection: keep-alive Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Content-Length: 0 Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Host: 10.222.0.40 Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Openstack-Api-Version: compute 2.92 Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Openstack-System-Scope: None Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: User-Agent: python-novaclient Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Auth-Token: gAAAAABjTNkaJ3BdhrGcpzzYnEandF5DjLbJQjR0k_a9qtXnhaGGXMnoxAVq9wtEzZU1y20nkYg1DsnqweUPZw8-r0wg6cp1fCJJ4Cex-rNVimpUhyyTmWzT6PZtB92zjexakm8K9OIpeLUfKB_1mdeqqQP0MeCnX2PFeVz9AvhQ2W7zmVfgtPM Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Domain-Id: None Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Domain-Name: None Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Identity-Status: Confirmed Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Is-Admin-Project: True Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Project-Domain-Id: default Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Project-Domain-Name: Default Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Project-Id: 5ca0ba3f46cd49c4906cecc8b33033b5 Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Project-Name: admin Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Role: reader,admin,member Oct 17 04:24:59.078040 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Roles: reader,admin,member Oct 17 04:24:59.079741 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:24:59.079741 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Tenant: admin Oct 17 04:24:59.079741 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Tenant-Id: 5ca0ba3f46cd49c4906cecc8b33033b5 Oct 17 04:24:59.079741 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Tenant-Name: admin Oct 17 04:24:59.079741 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-User: admin Oct 17 04:24:59.079741 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-User-Domain-Id: default Oct 17 04:24:59.079741 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-User-Domain-Name: Default Oct 17 04:24:59.079741 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-User-Id: 1ef52e31432e405791302fa724e9869f Oct 17 04:24:59.079741 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-User-Name: admin Oct 17 04:24:59.079741 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: method: > Oct 17 04:24:59.079741 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: exception: Flavor 42 could not be found. Oct 17 04:24:59.079741 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: action_args: {'id': '42'} Oct 17 04:24:59.079741 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:24:59.079741 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:24:59.080657 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 04:24:59.080657 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 04:24:59.080657 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 04:24:59.080657 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 04:24:59.080657 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 04:24:59.080657 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 04:24:59.080657 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 04:24:59.080657 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 04:24:59.080657 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 04:24:59.080657 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:24:59.080657 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 04:24:59.080657 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 04:24:59.080657 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 04:24:59.080657 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Oct 17 04:24:59.080657 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:24:59.080657 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Oct 17 04:24:59.080657 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:24:59.080657 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:24:59.080657 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:24:59.081828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:24:59.081828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:24:59.081828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:24:59.081828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:24:59.081828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 04:24:59.081828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:24:59.081828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 04:24:59.081828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Oct 17 04:24:59.081828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:24:59.081828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Oct 17 04:24:59.081828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:24:59.081828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:24:59.081828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:24:59.081828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:24:59.081828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:24:59.081828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 04:24:59.081828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Oct 17 04:24:59.081828 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-d26519b3-50ed-457e-9c1f-73af8835d584 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:24:59.082973 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-d26519b3-50ed-457e-9c1f-73af8835d584 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.392543 Oct 17 04:24:59.082973 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Mon Oct 17 04:24:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 04:24:59.089629 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-32eb3a16-d2ad-47b7-ad98-98696e2bb5e8 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:59.111683 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-32eb3a16-d2ad-47b7-ad98-98696e2bb5e8 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025901 Oct 17 04:24:59.112219 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Oct 17 04:24:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:24:59.123095 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-cfe21f49-2c91-456f-ae65-0daae8c670e7 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:59.148229 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-cfe21f49-2c91-456f-ae65-0daae8c670e7 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029477 Oct 17 04:24:59.148784 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Oct 17 04:24:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:24:59.158337 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-def2e22a-a196-43b3-acd5-4a639c89892f admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:24:59.163885 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.wsgi [None req-def2e22a-a196-43b3-acd5-4a639c89892f admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-def2e22a-a196-43b3-acd5-4a639c89892f admin admin] Request method failure captured: Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Accept: application/json Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Accept-Encoding: gzip, deflate Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Connection: keep-alive Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Content-Length: 0 Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Host: 10.222.0.40 Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Openstack-Api-Version: compute 2.92 Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Openstack-System-Scope: None Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: User-Agent: python-novaclient Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Auth-Token: gAAAAABjTNkaJ3BdhrGcpzzYnEandF5DjLbJQjR0k_a9qtXnhaGGXMnoxAVq9wtEzZU1y20nkYg1DsnqweUPZw8-r0wg6cp1fCJJ4Cex-rNVimpUhyyTmWzT6PZtB92zjexakm8K9OIpeLUfKB_1mdeqqQP0MeCnX2PFeVz9AvhQ2W7zmVfgtPM Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Domain-Id: None Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Domain-Name: None Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Identity-Status: Confirmed Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Is-Admin-Project: True Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Project-Domain-Id: default Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Project-Domain-Name: Default Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Project-Id: 5ca0ba3f46cd49c4906cecc8b33033b5 Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Project-Name: admin Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Role: reader,admin,member Oct 17 04:24:59.167448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Roles: reader,admin,member Oct 17 04:24:59.168963 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:24:59.168963 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Tenant: admin Oct 17 04:24:59.168963 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Tenant-Id: 5ca0ba3f46cd49c4906cecc8b33033b5 Oct 17 04:24:59.168963 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Tenant-Name: admin Oct 17 04:24:59.168963 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-User: admin Oct 17 04:24:59.168963 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-User-Domain-Id: default Oct 17 04:24:59.168963 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-User-Domain-Name: Default Oct 17 04:24:59.168963 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-User-Id: 1ef52e31432e405791302fa724e9869f Oct 17 04:24:59.168963 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-User-Name: admin Oct 17 04:24:59.168963 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: method: > Oct 17 04:24:59.168963 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: exception: Flavor 42 could not be found. Oct 17 04:24:59.168963 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: action_args: {'id': '42'} Oct 17 04:24:59.168963 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:24:59.168963 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:24:59.169919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 04:24:59.169919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 04:24:59.169919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 04:24:59.169919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 04:24:59.169919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 04:24:59.169919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 04:24:59.169919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 04:24:59.169919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 04:24:59.169919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 04:24:59.169919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:24:59.169919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 04:24:59.169919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 04:24:59.169919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 04:24:59.169919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Oct 17 04:24:59.169919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:24:59.169919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Oct 17 04:24:59.169919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:24:59.169919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:24:59.169919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:24:59.171139 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:24:59.171139 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:24:59.171139 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:24:59.171139 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:24:59.171139 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 04:24:59.171139 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:24:59.171139 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 04:24:59.171139 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Oct 17 04:24:59.171139 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:24:59.171139 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Oct 17 04:24:59.171139 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:24:59.171139 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:24:59.171139 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:24:59.171139 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:24:59.171139 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:24:59.171139 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 04:24:59.171139 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Oct 17 04:24:59.171139 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-def2e22a-a196-43b3-acd5-4a639c89892f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:24:59.172344 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-def2e22a-a196-43b3-acd5-4a639c89892f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014022 Oct 17 04:24:59.172344 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Mon Oct 17 04:24:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 17 04:25:00.420928 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-cfe21f49-2c91-456f-ae65-0daae8c670e7 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:25:00.421975 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-cfe21f49-2c91-456f-ae65-0daae8c670e7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 17 04:25:00.422373 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Oct 17 04:25:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:25:00.946339 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-f366ad39-f01c-4786-816e-a09daec3bc2b admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:25:00.951645 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.wsgi [None req-f366ad39-f01c-4786-816e-a09daec3bc2b admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-f366ad39-f01c-4786-816e-a09daec3bc2b admin admin] Request method failure captured: Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Accept: application/json Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Accept-Encoding: gzip, deflate Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Connection: keep-alive Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Content-Length: 0 Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Host: 10.222.0.40 Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Openstack-Api-Version: compute 2.92 Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Openstack-System-Scope: None Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: User-Agent: python-novaclient Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Auth-Token: gAAAAABjTNkc91PBvyCGjfT7Yuq_vxPWTC_VxN-g-oaTCtXLsU2KyXf4GXF6bXy1yw7pHo3oCa_TnLsMXyUSNwtDRBSdwTEuJGOF9OHzI16BamJaccfCKd8-UDjpDzowxmkMG30h-_M4Uz2nwFNskh31jKuA095K5mYVMi4DUYmOsxpatkBkFsg Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Domain-Id: None Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Domain-Name: None Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Identity-Status: Confirmed Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Is-Admin-Project: True Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Project-Domain-Id: default Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Project-Domain-Name: Default Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Project-Id: 5ca0ba3f46cd49c4906cecc8b33033b5 Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Project-Name: admin Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Role: reader,admin,member Oct 17 04:25:00.953206 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Roles: reader,admin,member Oct 17 04:25:00.954520 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:25:00.954520 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Tenant: admin Oct 17 04:25:00.954520 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Tenant-Id: 5ca0ba3f46cd49c4906cecc8b33033b5 Oct 17 04:25:00.954520 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Tenant-Name: admin Oct 17 04:25:00.954520 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-User: admin Oct 17 04:25:00.954520 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-User-Domain-Id: default Oct 17 04:25:00.954520 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-User-Domain-Name: Default Oct 17 04:25:00.954520 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-User-Id: 1ef52e31432e405791302fa724e9869f Oct 17 04:25:00.954520 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-User-Name: admin Oct 17 04:25:00.954520 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: method: > Oct 17 04:25:00.954520 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: exception: Flavor 84 could not be found. Oct 17 04:25:00.954520 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: action_args: {'id': '84'} Oct 17 04:25:00.954520 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:25:00.954520 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:25:00.955361 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 04:25:00.955361 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 04:25:00.955361 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 04:25:00.955361 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 04:25:00.955361 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 04:25:00.955361 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 04:25:00.955361 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 04:25:00.955361 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 04:25:00.955361 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 04:25:00.955361 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:25:00.955361 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 04:25:00.955361 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 04:25:00.955361 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 04:25:00.955361 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Oct 17 04:25:00.955361 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:25:00.955361 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Oct 17 04:25:00.955361 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:25:00.955361 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:25:00.955361 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:25:00.956556 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:25:00.956556 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:25:00.956556 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:25:00.956556 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:25:00.956556 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 04:25:00.956556 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:25:00.956556 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 04:25:00.956556 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Oct 17 04:25:00.956556 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:25:00.956556 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Oct 17 04:25:00.956556 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:25:00.956556 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:25:00.956556 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:25:00.956556 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:25:00.956556 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:25:00.956556 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 04:25:00.956556 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Oct 17 04:25:00.956556 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-f366ad39-f01c-4786-816e-a09daec3bc2b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:25:00.957704 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-f366ad39-f01c-4786-816e-a09daec3bc2b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.392046 Oct 17 04:25:00.957704 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Mon Oct 17 04:25:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 04:25:00.965050 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-3bfbce75-f533-4afc-b1e4-6eb92e09f7d3 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:25:00.979876 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-3bfbce75-f533-4afc-b1e4-6eb92e09f7d3 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018340 Oct 17 04:25:00.980328 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Oct 17 04:25:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:25:00.990316 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-5561aced-0e24-4caa-81a0-bd080a8e4733 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:25:01.007391 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-5561aced-0e24-4caa-81a0-bd080a8e4733 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020619 Oct 17 04:25:01.007955 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Oct 17 04:25:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:25:01.019241 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-51905c1a-1ea2-4d14-bd6f-2c1ab5cb9428 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:25:01.025338 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.wsgi [None req-51905c1a-1ea2-4d14-bd6f-2c1ab5cb9428 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-51905c1a-1ea2-4d14-bd6f-2c1ab5cb9428 admin admin] Request method failure captured: Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Accept: application/json Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Accept-Encoding: gzip, deflate Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Connection: keep-alive Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Content-Length: 0 Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Host: 10.222.0.40 Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Openstack-Api-Version: compute 2.92 Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Openstack-System-Scope: None Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: User-Agent: python-novaclient Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Auth-Token: gAAAAABjTNkc91PBvyCGjfT7Yuq_vxPWTC_VxN-g-oaTCtXLsU2KyXf4GXF6bXy1yw7pHo3oCa_TnLsMXyUSNwtDRBSdwTEuJGOF9OHzI16BamJaccfCKd8-UDjpDzowxmkMG30h-_M4Uz2nwFNskh31jKuA095K5mYVMi4DUYmOsxpatkBkFsg Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Domain-Id: None Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Domain-Name: None Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Identity-Status: Confirmed Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Is-Admin-Project: True Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Project-Domain-Id: default Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Project-Domain-Name: Default Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Project-Id: 5ca0ba3f46cd49c4906cecc8b33033b5 Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Project-Name: admin Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Role: reader,admin,member Oct 17 04:25:01.026859 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Roles: reader,admin,member Oct 17 04:25:01.028513 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:25:01.028513 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Tenant: admin Oct 17 04:25:01.028513 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Tenant-Id: 5ca0ba3f46cd49c4906cecc8b33033b5 Oct 17 04:25:01.028513 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Tenant-Name: admin Oct 17 04:25:01.028513 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-User: admin Oct 17 04:25:01.028513 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-User-Domain-Id: default Oct 17 04:25:01.028513 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-User-Domain-Name: Default Oct 17 04:25:01.028513 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-User-Id: 1ef52e31432e405791302fa724e9869f Oct 17 04:25:01.028513 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-User-Name: admin Oct 17 04:25:01.028513 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: method: > Oct 17 04:25:01.028513 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: exception: Flavor 84 could not be found. Oct 17 04:25:01.028513 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: action_args: {'id': '84'} Oct 17 04:25:01.028513 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:25:01.028513 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:25:01.029668 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 04:25:01.029668 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 04:25:01.029668 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 04:25:01.029668 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 04:25:01.029668 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 04:25:01.029668 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 04:25:01.029668 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 04:25:01.029668 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 04:25:01.029668 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 04:25:01.029668 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:25:01.029668 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 04:25:01.029668 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 04:25:01.029668 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 04:25:01.029668 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Oct 17 04:25:01.029668 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:25:01.029668 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Oct 17 04:25:01.029668 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:25:01.029668 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:25:01.029668 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:25:01.031019 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:25:01.031019 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:25:01.031019 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:25:01.031019 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:25:01.031019 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 04:25:01.031019 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:25:01.031019 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 04:25:01.031019 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Oct 17 04:25:01.031019 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:25:01.031019 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Oct 17 04:25:01.031019 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:25:01.031019 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:25:01.031019 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:25:01.031019 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:25:01.031019 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:25:01.031019 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 04:25:01.031019 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Oct 17 04:25:01.031019 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-51905c1a-1ea2-4d14-bd6f-2c1ab5cb9428 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:25:01.032268 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-51905c1a-1ea2-4d14-bd6f-2c1ab5cb9428 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.014028 Oct 17 04:25:01.032268 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Mon Oct 17 04:25:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 04:25:02.243597 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-5561aced-0e24-4caa-81a0-bd080a8e4733 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:25:02.244608 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-5561aced-0e24-4caa-81a0-bd080a8e4733 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 17 04:25:02.245002 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Oct 17 04:25:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:25:02.770024 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-859a157c-7205-486a-9c0b-76cefd8f9635 admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:25:02.776491 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.wsgi [None req-859a157c-7205-486a-9c0b-76cefd8f9635 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-859a157c-7205-486a-9c0b-76cefd8f9635 admin admin] Request method failure captured: Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Accept: application/json Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Accept-Encoding: gzip, deflate Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Connection: keep-alive Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Content-Length: 0 Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Host: 10.222.0.40 Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Openstack-Api-Version: compute 2.92 Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Openstack-System-Scope: None Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: User-Agent: python-novaclient Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Auth-Token: gAAAAABjTNkecCIXNsdBRFq0Jc5RY9T_MgICWHM09cRsYvFUdaXCPRdsxHbL9ZSd2ycRoxZMf-iNy_ivxeFe6QkItYhUimK_yIXqs-a8R_BvrZXnOf9v3FIqr-Ni4z-7maqPHNlJQevB6gkbUoTa8behNWYiwftZrSP20Xkikz7b8jyBVPYgR7k Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Domain-Id: None Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Domain-Name: None Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Identity-Status: Confirmed Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Is-Admin-Project: True Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Project-Domain-Id: default Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Project-Domain-Name: Default Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Project-Id: 5ca0ba3f46cd49c4906cecc8b33033b5 Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Project-Name: admin Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Role: reader,admin,member Oct 17 04:25:02.778031 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Roles: reader,admin,member Oct 17 04:25:02.779647 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:25:02.779647 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Tenant: admin Oct 17 04:25:02.779647 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Tenant-Id: 5ca0ba3f46cd49c4906cecc8b33033b5 Oct 17 04:25:02.779647 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-Tenant-Name: admin Oct 17 04:25:02.779647 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-User: admin Oct 17 04:25:02.779647 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-User-Domain-Id: default Oct 17 04:25:02.779647 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-User-Domain-Name: Default Oct 17 04:25:02.779647 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-User-Id: 1ef52e31432e405791302fa724e9869f Oct 17 04:25:02.779647 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: X-User-Name: admin Oct 17 04:25:02.779647 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: method: > Oct 17 04:25:02.779647 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: exception: Flavor 451 could not be found. Oct 17 04:25:02.779647 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: action_args: {'id': '451'} Oct 17 04:25:02.779647 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:25:02.779647 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:25:02.780702 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 04:25:02.780702 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 04:25:02.780702 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 04:25:02.780702 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 04:25:02.780702 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 04:25:02.780702 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 04:25:02.780702 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 04:25:02.780702 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 04:25:02.780702 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 04:25:02.780702 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:25:02.780702 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 04:25:02.780702 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 04:25:02.780702 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 04:25:02.780702 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Oct 17 04:25:02.780702 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:25:02.780702 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Oct 17 04:25:02.780702 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:25:02.780702 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:25:02.780702 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:25:02.782104 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:25:02.782104 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:25:02.782104 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:25:02.782104 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:25:02.782104 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 04:25:02.782104 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:25:02.782104 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 04:25:02.782104 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Oct 17 04:25:02.782104 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:25:02.782104 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Oct 17 04:25:02.782104 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:25:02.782104 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:25:02.782104 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:25:02.782104 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:25:02.782104 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:25:02.782104 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 04:25:02.782104 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: ERROR nova.api.openstack.wsgi Oct 17 04:25:02.782104 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-859a157c-7205-486a-9c0b-76cefd8f9635 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:25:02.783346 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-859a157c-7205-486a-9c0b-76cefd8f9635 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.394673 Oct 17 04:25:02.783346 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Oct 17 04:25:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 04:25:02.790314 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-788cf9de-8710-4e71-8eb9-d266ab4f8faf admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:25:02.805546 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-788cf9de-8710-4e71-8eb9-d266ab4f8faf admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019864 Oct 17 04:25:02.806065 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Oct 17 04:25:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:25:02.815210 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-39a30c83-b187-4238-b163-f234b447c2bc admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:25:02.830285 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-39a30c83-b187-4238-b163-f234b447c2bc admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018497 Oct 17 04:25:02.830799 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Oct 17 04:25:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:25:02.840616 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-95522bbc-6c1a-4870-96cb-238976714cef admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:25:02.845506 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.wsgi [None req-95522bbc-6c1a-4870-96cb-238976714cef admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-95522bbc-6c1a-4870-96cb-238976714cef admin admin] Request method failure captured: Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Accept: application/json Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Accept-Encoding: gzip, deflate Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Connection: keep-alive Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Content-Length: 0 Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Host: 10.222.0.40 Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Openstack-Api-Version: compute 2.92 Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Openstack-System-Scope: None Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: User-Agent: python-novaclient Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Auth-Token: gAAAAABjTNkecCIXNsdBRFq0Jc5RY9T_MgICWHM09cRsYvFUdaXCPRdsxHbL9ZSd2ycRoxZMf-iNy_ivxeFe6QkItYhUimK_yIXqs-a8R_BvrZXnOf9v3FIqr-Ni4z-7maqPHNlJQevB6gkbUoTa8behNWYiwftZrSP20Xkikz7b8jyBVPYgR7k Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Domain-Id: None Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Domain-Name: None Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Identity-Status: Confirmed Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Is-Admin-Project: True Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Project-Domain-Id: default Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Project-Domain-Name: Default Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Project-Id: 5ca0ba3f46cd49c4906cecc8b33033b5 Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Project-Name: admin Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Role: reader,admin,member Oct 17 04:25:02.847022 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Roles: reader,admin,member Oct 17 04:25:02.848544 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ca0ba3f46cd49c4906cecc8b33033b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:25:02.848544 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Tenant: admin Oct 17 04:25:02.848544 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Tenant-Id: 5ca0ba3f46cd49c4906cecc8b33033b5 Oct 17 04:25:02.848544 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-Tenant-Name: admin Oct 17 04:25:02.848544 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-User: admin Oct 17 04:25:02.848544 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-User-Domain-Id: default Oct 17 04:25:02.848544 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-User-Domain-Name: Default Oct 17 04:25:02.848544 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-User-Id: 1ef52e31432e405791302fa724e9869f Oct 17 04:25:02.848544 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: X-User-Name: admin Oct 17 04:25:02.848544 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: method: > Oct 17 04:25:02.848544 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: exception: Flavor 451 could not be found. Oct 17 04:25:02.848544 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: action_args: {'id': '451'} Oct 17 04:25:02.848544 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:25:02.848544 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:25:02.849560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 04:25:02.849560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 04:25:02.849560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 04:25:02.849560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 04:25:02.849560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 04:25:02.849560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 04:25:02.849560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 04:25:02.849560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 04:25:02.849560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 04:25:02.849560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:25:02.849560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 04:25:02.849560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 04:25:02.849560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 04:25:02.849560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Oct 17 04:25:02.849560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:25:02.849560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Oct 17 04:25:02.849560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:25:02.849560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:25:02.849560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:25:02.851243 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:25:02.851243 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:25:02.851243 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:25:02.851243 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:25:02.851243 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 04:25:02.851243 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:25:02.851243 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 04:25:02.851243 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Oct 17 04:25:02.851243 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:25:02.851243 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Oct 17 04:25:02.851243 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:25:02.851243 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:25:02.851243 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:25:02.851243 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:25:02.851243 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:25:02.851243 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 04:25:02.851243 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Oct 17 04:25:02.851243 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-95522bbc-6c1a-4870-96cb-238976714cef admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:25:02.852471 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-95522bbc-6c1a-4870-96cb-238976714cef admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011232 Oct 17 04:25:02.852471 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Oct 17 04:25:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 17 04:25:04.065553 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-39a30c83-b187-4238-b163-f234b447c2bc admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:25:04.066567 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-39a30c83-b187-4238-b163-f234b447c2bc admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 17 04:25:04.066958 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Oct 17 04:25:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:25:04.590379 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-b443cc1d-b1f2-43c0-97cd-b925df8e0051 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:25:04.610919 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-b443cc1d-b1f2-43c0-97cd-b925df8e0051 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.405507 Oct 17 04:25:04.611448 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Mon Oct 17 04:25:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 04:25:05.830034 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-39a30c83-b187-4238-b163-f234b447c2bc admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:25:05.831042 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-39a30c83-b187-4238-b163-f234b447c2bc admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 17 04:25:05.831434 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Oct 17 04:25:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:25:06.357002 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-26e96885-1783-45c5-9442-e025516a2eda admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:25:06.375826 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-26e96885-1783-45c5-9442-e025516a2eda admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.405157 Oct 17 04:25:06.376371 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Mon Oct 17 04:25:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 04:25:07.594750 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-39a30c83-b187-4238-b163-f234b447c2bc admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:25:07.595760 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-39a30c83-b187-4238-b163-f234b447c2bc admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Oct 17 04:25:07.596154 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Oct 17 04:25:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:25:08.119609 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-f2b636b8-5a89-48a6-9bdd-ca48874f3ec3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:25:08.138489 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-f2b636b8-5a89-48a6-9bdd-ca48874f3ec3 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.402388 Oct 17 04:25:08.139027 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Mon Oct 17 04:25:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 04:25:09.360924 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-39a30c83-b187-4238-b163-f234b447c2bc admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:25:09.361956 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-39a30c83-b187-4238-b163-f234b447c2bc admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 17 04:25:09.362347 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Oct 17 04:25:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:25:09.886294 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-2e24d03f-f06f-44a2-a8bd-be312b4e878a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:25:09.904215 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-2e24d03f-f06f-44a2-a8bd-be312b4e878a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.404368 Oct 17 04:25:09.904740 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Mon Oct 17 04:25:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 04:25:11.119196 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-39a30c83-b187-4238-b163-f234b447c2bc admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:25:11.120312 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-39a30c83-b187-4238-b163-f234b447c2bc admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Oct 17 04:25:11.120885 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Oct 17 04:25:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:25:11.634417 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-d1c94ad8-ab67-4da7-91d2-ee2d7d368202 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:25:11.654817 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-d1c94ad8-ab67-4da7-91d2-ee2d7d368202 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.399584 Oct 17 04:25:11.655346 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Mon Oct 17 04:25:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:26:08.111000 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-39a30c83-b187-4238-b163-f234b447c2bc admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:26:08.111997 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-39a30c83-b187-4238-b163-f234b447c2bc admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 17 04:26:08.112390 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 931 bytes} [Mon Oct 17 04:26:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:26:08.123852 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:26:08.505442 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-a6bb6cf3-47e0-45ff-b7ab-5ecbfba3f08b admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:26:08.525623 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-a6bb6cf3-47e0-45ff-b7ab-5ecbfba3f08b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406297 Oct 17 04:26:08.526161 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1292 bytes} [Mon Oct 17 04:26:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:26:08.547593 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writing DB stats nova_api:SELECT=14 {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:26:08.551543 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-4197062e-e30e-43ed-8a1d-ec806b20d0ca admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:26:08.559521 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-4197062e-e30e-43ed-8a1d-ec806b20d0ca admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013335 Oct 17 04:26:08.560041 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1283 bytes} [Mon Oct 17 04:26:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:26:08.571545 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-9f266534-cea2-425e-903a-37e4d888473e admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:26:08.579018 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-9f266534-cea2-425e-903a-37e4d888473e admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011079 Oct 17 04:26:08.579530 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1286 bytes} [Mon Oct 17 04:26:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:26:08.591115 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-db57940f-fa5a-4bb2-954c-7ca71d5e55cd admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:26:08.598377 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-db57940f-fa5a-4bb2-954c-7ca71d5e55cd admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010758 Oct 17 04:26:08.598887 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1286 bytes} [Mon Oct 17 04:26:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:26:08.610411 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-168f177c-f130-4db1-94ea-ef2acf2337c3 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:26:08.617435 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-168f177c-f130-4db1-94ea-ef2acf2337c3 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010416 Oct 17 04:26:08.617940 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1283 bytes} [Mon Oct 17 04:26:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:29:00.552210 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-db57940f-fa5a-4bb2-954c-7ca71d5e55cd admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:29:00.553261 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-db57940f-fa5a-4bb2-954c-7ca71d5e55cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Oct 17 04:29:00.553651 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Oct 17 04:29:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:29:00.691393 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_api:SELECT=6 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:29:00.849951 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-daa35b44-3da7-45b4-90bc-0e48d07e3082 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:29:00.855129 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-daa35b44-3da7-45b4-90bc-0e48d07e3082 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:29:00.855604 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-daa35b44-3da7-45b4-90bc-0e48d07e3082 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:29:00.856029 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-daa35b44-3da7-45b4-90bc-0e48d07e3082 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:29:00.856735 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-daa35b44-3da7-45b4-90bc-0e48d07e3082 admin admin] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:29:00.857213 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-daa35b44-3da7-45b4-90bc-0e48d07e3082 admin admin] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:29:00.857631 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-daa35b44-3da7-45b4-90bc-0e48d07e3082 admin admin] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:29:00.889489 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-daa35b44-3da7-45b4-90bc-0e48d07e3082 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.199238 Oct 17 04:29:00.890028 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Oct 17 04:29:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 04:29:01.974838 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-db57940f-fa5a-4bb2-954c-7ca71d5e55cd admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:29:01.975839 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-db57940f-fa5a-4bb2-954c-7ca71d5e55cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 17 04:29:01.976256 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Oct 17 04:29:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:29:02.169049 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-b76fc3a8-9cd4-4bb0-8fac-bde719efedd6 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:29:02.172479 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-b76fc3a8-9cd4-4bb0-8fac-bde719efedd6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:29:02.172988 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-b76fc3a8-9cd4-4bb0-8fac-bde719efedd6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:29:02.173475 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-b76fc3a8-9cd4-4bb0-8fac-bde719efedd6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:29:02.174193 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-b76fc3a8-9cd4-4bb0-8fac-bde719efedd6 admin admin] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:29:02.174650 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-b76fc3a8-9cd4-4bb0-8fac-bde719efedd6 admin admin] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:29:02.175068 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-b76fc3a8-9cd4-4bb0-8fac-bde719efedd6 admin admin] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:29:02.194879 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-b76fc3a8-9cd4-4bb0-8fac-bde719efedd6 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.078499 Oct 17 04:29:02.195424 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Oct 17 04:29:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 04:29:13.666676 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-db57940f-fa5a-4bb2-954c-7ca71d5e55cd admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:29:13.667670 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-db57940f-fa5a-4bb2-954c-7ca71d5e55cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Oct 17 04:29:13.668059 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Oct 17 04:29:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:29:13.818075 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_cell0:SELECT=4 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:29:13.818769 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_cell1:SELECT=4 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:29:13.819363 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_api:SELECT=8 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:29:13.871072 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-da072ce2-efcc-459d-a0a9-9652ac5ea49e admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:29:13.874560 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-da072ce2-efcc-459d-a0a9-9652ac5ea49e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:29:13.874981 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-da072ce2-efcc-459d-a0a9-9652ac5ea49e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:29:13.875407 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-da072ce2-efcc-459d-a0a9-9652ac5ea49e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:29:13.876112 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-da072ce2-efcc-459d-a0a9-9652ac5ea49e admin admin] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:29:13.876558 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-da072ce2-efcc-459d-a0a9-9652ac5ea49e admin admin] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:29:13.876970 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-da072ce2-efcc-459d-a0a9-9652ac5ea49e admin admin] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:29:13.901904 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-da072ce2-efcc-459d-a0a9-9652ac5ea49e admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.088203 Oct 17 04:29:13.902441 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Oct 17 04:29:13 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:29:14.979823 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG nova.api.openstack.wsgi [None req-db57940f-fa5a-4bb2-954c-7ca71d5e55cd admin admin] Calling method '>' {{(pid=103705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:29:14.980901 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: INFO nova.api.openstack.requestlog [None req-db57940f-fa5a-4bb2-954c-7ca71d5e55cd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 17 04:29:14.981332 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: [pid: 103705|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Oct 17 04:29:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:29:15.170657 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-5c2a001b-20cd-4743-af50-551f4754e933 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:29:15.174000 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-5c2a001b-20cd-4743-af50-551f4754e933 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:29:15.174467 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-5c2a001b-20cd-4743-af50-551f4754e933 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:29:15.174886 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-5c2a001b-20cd-4743-af50-551f4754e933 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:29:15.175590 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-5c2a001b-20cd-4743-af50-551f4754e933 admin admin] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:29:15.176032 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-5c2a001b-20cd-4743-af50-551f4754e933 admin admin] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:29:15.176443 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-5c2a001b-20cd-4743-af50-551f4754e933 admin admin] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:29:15.198965 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-5c2a001b-20cd-4743-af50-551f4754e933 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.079572 Oct 17 04:29:15.199436 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Oct 17 04:29:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:30:11.321003 dv-cinder-861557-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 17 04:30:11.322021 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: Mon Oct 17 04:30:11 2022 - graceful shutdown triggered... Oct 17 04:30:11.322521 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: Gracefully killing worker 1 (pid: 103705)... Oct 17 04:30:11.322885 dv-cinder-861557-1-iscsi devstack@n-api.service[103706]: Gracefully killing worker 2 (pid: 103706)... Oct 17 04:30:11.449204 dv-cinder-861557-1-iscsi devstack@n-api.service[103705]: DEBUG dbcounter [-] [103705] Writing DB stats nova_api:SELECT=4 {{(pid=103705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:30:12.323177 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: worker 1 buried after 1 seconds Oct 17 04:30:12.323615 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: worker 2 buried after 1 seconds Oct 17 04:30:12.323615 dv-cinder-861557-1-iscsi devstack@n-api.service[103704]: goodbye to uWSGI. Oct 17 04:30:12.325197 dv-cinder-861557-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 17 04:30:12.326156 dv-cinder-861557-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 17 04:30:12.329154 dv-cinder-861557-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 04:30:12.339416 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 04:30:12.341871 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 04:30:12 2022] *** Oct 17 04:30:12.341871 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 04:30:12.341871 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 04:30:12.341871 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: nodename: dv-cinder-861557-1-iscsi Oct 17 04:30:12.341871 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: machine: x86_64 Oct 17 04:30:12.341871 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: clock source: unix Oct 17 04:30:12.341871 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: pcre jit disabled Oct 17 04:30:12.341871 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: detected number of CPU cores: 4 Oct 17 04:30:12.341871 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: current working directory: / Oct 17 04:30:12.341871 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: detected binary path: /usr/bin/uwsgi-core Oct 17 04:30:12.341871 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: your processes number limit is 47680 Oct 17 04:30:12.341871 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: your memory page size is 4096 bytes Oct 17 04:30:12.342815 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: detected max file descriptor number: 2048 Oct 17 04:30:12.342815 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: lock engine: pthread robust mutexes Oct 17 04:30:12.342815 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: thunder lock: enabled Oct 17 04:30:12.342815 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 04:30:12.342815 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 04:30:12.382354 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: Python main interpreter initialized at 0x557a39d959c0 Oct 17 04:30:12.382354 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: python threads support enabled Oct 17 04:30:12.382354 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: your server socket listen backlog is limited to 100 connections Oct 17 04:30:12.382354 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: your mercy for graceful operations on workers is 90 seconds Oct 17 04:30:12.382708 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 04:30:12.382708 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: *** Operational MODE: preforking *** Oct 17 04:30:12.383013 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: *** uWSGI is running in multiple interpreter mode *** Oct 17 04:30:12.383013 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: spawned uWSGI master process (pid: 119126) Oct 17 04:30:12.383163 dv-cinder-861557-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 17 04:30:12.383740 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: spawned uWSGI worker 1 (pid: 119127, cores: 1) Oct 17 04:30:12.384050 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: spawned uWSGI worker 2 (pid: 119128, cores: 1) Oct 17 04:30:12.384230 dv-cinder-861557-1-iscsi devstack@n-api.service[119126]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 04:30:13.050678 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 04:30:13.051292 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 04:30:14.218018 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 04:30:14.218018 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: from cryptography.utils import int_from_bytes Oct 17 04:30:14.218760 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 04:30:14.218760 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: from cryptography.utils import int_from_bytes Oct 17 04:30:14.241215 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 04:30:14.241215 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: from cryptography.utils import int_from_bytes Oct 17 04:30:14.241878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 04:30:14.241878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: from cryptography.utils import int_from_bytes Oct 17 04:30:16.677257 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 04:30:16.677882 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 04:30:16.678066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 04:30:16.678434 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 04:30:16.679732 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 04:30:16.679732 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.679732 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.679732 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.680101 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.680305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.680667 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.680927 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.681284 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.681643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.681904 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.682218 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.682715 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861557-1-iscsi {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.683034 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.683344 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.683662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.684501 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.685000 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.685300 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.685614 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.686128 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.686583 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.686891 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.687241 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.687540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.687859 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.688161 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.688481 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.688785 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.689149 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.689469 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.689871 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861557-1-iscsi {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.690286 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.690582 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.690894 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.691320 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.691624 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.691928 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.692243 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.692747 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.693061 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.693415 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.693734 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.694053 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.694377 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.694676 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.694983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.695292 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.695610 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.695914 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.696217 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.696466 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.696770 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.697110 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.697431 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.697751 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.698001 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.698248 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.698565 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.698884 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.699187 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.700050 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.700436 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.700741 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.701050 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.701646 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.701953 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.702255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.702574 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.702888 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.703208 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.703512 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.703828 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.704238 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.704488 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.704793 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.705180 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.705481 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.705785 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.706103 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.706419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.706724 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.707029 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.707332 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.707649 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.707981 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.708282 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.708528 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.708831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.709176 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.709488 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.709789 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.710096 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.710403 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.710700 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.711020 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.711312 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.711614 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.711919 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.712223 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.712526 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.712827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.713156 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.713466 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.713770 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.714095 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.714415 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.714719 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.715062 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.715366 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.715673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.715992 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.716297 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.716601 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.716922 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.717259 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.717564 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.717882 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.718185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.718486 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.718800 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.719097 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.719400 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.719717 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.720018 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.720322 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.720622 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.720930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.721291 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.721596 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.721900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.722205 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.722501 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.722820 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.723140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.723448 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.723752 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.724060 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.724377 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.724718 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.725048 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.725424 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.725736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.726065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.726392 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.726711 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.727021 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.727335 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.727659 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.727969 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.728276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.728584 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.728902 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.729314 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.729573 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.729888 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.730199 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.730513 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.730859 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.731179 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.731507 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.731827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.732139 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.732482 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.732826 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.733165 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.733492 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.733818 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.734185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.734446 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.734759 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.735097 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.735410 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.735720 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.736037 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.736346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.736667 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.736978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.737312 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.737623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.737933 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.738241 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.738580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.738895 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.739215 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.739532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.739841 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.740160 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.740637 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.740961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.741296 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.741640 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.741944 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.742247 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.742553 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.742854 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.743174 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.743501 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.743808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.744144 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.744454 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.744766 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.745087 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.745403 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.745706 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.746016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.746848 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.747152 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.747471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.747781 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.748086 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.748406 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.748505 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 04:30:16.748959 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.749051 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 04:30:16.749192 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.749281 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 04:30:16.749381 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.749649 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 04:30:16.749743 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.749912 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 04:30:16.750019 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.750282 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.750394 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.750588 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.750689 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.750909 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.751054 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.751237 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.751386 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.751533 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.751633 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.751850 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.751944 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.752177 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.752288 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.752676 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.752838 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.752983 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.753138 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.753286 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.753379 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.753506 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.753608 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.753785 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.753876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861557-1-iscsi {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.754094 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.754196 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.754404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.754507 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.754751 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.754847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.755072 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.755162 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.755379 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.755477 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.755680 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.755778 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.755983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.756074 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.756284 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.756512 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.756625 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.756834 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.756932 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.757168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.757278 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.757486 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.757586 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.757795 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.757894 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.758100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.758201 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.758404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.758508 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.758742 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.758832 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.759045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.759135 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.759368 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.759465 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.759684 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.759783 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.760011 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.760101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861557-1-iscsi {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.760337 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.760450 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.760648 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.760750 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.760966 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.761059 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.761306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.761432 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.761656 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.761753 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.762565 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.762680 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.762838 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.762931 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.763159 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.763330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.763474 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.763648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.763797 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.763980 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.764110 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.764304 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.764439 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.764626 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.764752 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.764934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.765117 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.765270 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.765400 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.765584 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.765714 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.765897 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.766054 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.766219 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.766387 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.766528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.766703 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.766836 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.767024 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.767132 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.767335 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.767427 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.767651 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.767763 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.767959 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.768053 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.768268 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.768359 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.768561 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.768652 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.768816 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.768917 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.769168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.769265 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.769493 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.769596 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.769807 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.769898 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.770115 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.770212 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.770428 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.770542 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.770731 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.770823 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.771038 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.771137 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.771337 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.771441 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.771734 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.771837 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.771954 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.772046 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.772276 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.772381 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.772583 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.772692 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.772896 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.773006 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.773227 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.773321 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.773536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.773627 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.773844 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.773937 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.774154 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.774247 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.774463 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.774554 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.774766 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.774859 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.775075 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.775179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.775388 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.775488 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.775698 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.775789 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.776009 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.776111 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.776312 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.776415 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.776621 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.776722 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.776926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.777017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.777252 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.777348 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.777684 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.777802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.777996 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.778097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.778311 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.778451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.778620 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.778723 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.778931 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.779031 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.779248 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.779339 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.779552 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.779657 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.779854 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.779946 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.780168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.780265 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.780491 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.780630 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.780780 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.780931 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.781100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.781210 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.781409 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.781558 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.781718 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.781832 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.782033 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.782138 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.782343 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.782437 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.782663 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.782808 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.782961 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.783167 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.783278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.783377 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.783571 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.783672 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.783881 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.783972 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.784189 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.784282 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.784499 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.784589 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.784810 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.784924 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.785138 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.785259 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.785452 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.785572 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.785760 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.785887 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.786070 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.786198 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.786379 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.786501 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.786705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.786844 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.787016 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.787166 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.787325 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.787480 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.787817 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.787950 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.788072 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.788184 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.788304 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.788417 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.788571 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.788699 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.788875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.789653 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.789810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.789927 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.790039 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.790151 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.790270 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.790392 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.790512 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.790730 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.790852 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.790966 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.791109 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.791251 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.791343 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.791438 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.791613 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.791704 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.791880 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.791973 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.792186 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.792317 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.792508 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.792610 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.792810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.792913 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.793175 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.793299 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.793494 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.793638 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.793856 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.793953 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.794187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 04:30:16.794281 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.794533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.794628 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.794861 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.794960 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.795167 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.795271 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.795473 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.795576 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.795778 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.795873 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.796085 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.796188 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.796403 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.796504 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.796706 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.796800 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.797016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.797154 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.797346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.797450 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.797672 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.797835 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.797987 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.798103 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.798292 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.798386 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.798597 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.798698 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.798903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.799005 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.799247 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.799349 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.799552 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.799653 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.799879 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.799979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.800202 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.800303 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.800521 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.800623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.800831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.800931 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.801172 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.801329 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.801487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.801582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.801788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.801882 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.802092 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.802196 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.802398 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.802524 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.802706 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.802859 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.803025 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.803222 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.803394 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.803558 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.803704 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.803846 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.803987 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.804134 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.804291 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.804449 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.804599 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.804699 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.804794 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.804949 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.805044 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.805292 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.805397 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.805618 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.805712 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.805935 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.806039 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.806253 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.806353 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.806554 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.806656 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.806863 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.806970 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.807168 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.807271 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.807468 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.807570 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.807775 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.807946 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.808082 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.808173 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.808376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.808470 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.808679 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.809295 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.809527 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.809621 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.809830 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.810006 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.810139 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.810339 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.810441 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.810658 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.810758 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.810976 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.811087 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.811308 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.811423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.811596 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.811690 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.811909 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.812044 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.812214 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.812377 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.812535 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.812730 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.812879 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.813036 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.813209 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.813383 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.813582 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.813741 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.813892 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.814040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.814188 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.814329 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.814476 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.814617 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.814777 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.814925 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.815066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.815208 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.815347 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.815489 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.815592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.815679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.815771 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.815901 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.816028 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.816218 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.816319 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.816529 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.816621 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.816858 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.816959 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.817236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.817335 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.817545 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.817638 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.817847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.817982 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.818149 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.818243 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.818435 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.818527 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.818778 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.818879 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.819083 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.819184 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.819397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.819487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.819714 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.819867 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.820030 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.820130 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.820345 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.820443 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.820655 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.820760 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.820995 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.821141 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.821331 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.821483 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.821626 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.821729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.821954 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.822088 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.822257 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.822408 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.822556 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.822661 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.822862 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.823020 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.823165 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.823308 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.823451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.823622 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.823762 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.823853 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.824062 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.824155 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.824431 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.824588 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.824748 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.824929 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.825224 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.825322 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.825532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.825628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.825839 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.825933 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.826149 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.826248 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.826726 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.826894 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.827048 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.827199 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.827340 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.827484 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.827647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.827793 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.827948 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.828091 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.828198 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.828297 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.828514 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.828621 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.828823 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.828928 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.829154 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.829266 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.829470 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.829573 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.829780 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.829883 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.830084 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.830189 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.830407 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.830502 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.830720 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.830822 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.831023 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.831127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.831334 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.831440 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.831638 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.831736 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.831948 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.832051 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.832255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.832387 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.832646 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.832752 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.832970 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.833094 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.833306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.833407 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.833612 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.833705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.833910 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.834015 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.834221 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.834315 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.834535 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.834636 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.834855 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.834958 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.835160 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.835252 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.835522 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.835627 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.835848 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.835955 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.836169 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.836261 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.836478 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.836580 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.836780 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.836874 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.837113 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.837211 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.837412 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.837516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.837726 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.837825 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.838028 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.838194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.838330 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.838437 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.838632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.838733 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.838951 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.839044 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.839254 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.839347 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.839571 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.839664 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.839886 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.840506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.840834 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.840986 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.841274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.841400 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.841527 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.841718 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.841866 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.842030 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.842208 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.842345 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.842529 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.842647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.842851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.842957 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.843183 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.843290 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.843499 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.843685 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.843820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.843992 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.844132 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.844270 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.844435 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.844589 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.844739 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.844883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.845051 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.845223 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.845400 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.845517 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.845707 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.845798 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.846023 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.846114 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.846333 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.846439 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.846643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.846741 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.846956 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.847046 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.847265 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.847443 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.847612 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.847703 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.847880 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.847981 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.848207 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.848300 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.848525 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.848808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.848908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.849146 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.849244 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.849454 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.849548 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.849766 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.849867 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.850085 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.850194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.850375 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.850469 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.850696 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.850797 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.851001 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.851094 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.851312 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.851451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.851618 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.851733 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.851930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.852093 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.852243 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.852394 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.852535 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.852643 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.852825 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.852928 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.853150 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.853263 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.853475 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.853598 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.853785 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.853880 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.854107 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.854213 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.854423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.854540 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.854725 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.854820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.855045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.855147 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.855354 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.855458 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.855790 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.856077 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.856207 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.856342 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.856450 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.856539 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.856721 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.856824 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.857026 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.857147 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.857395 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.857491 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.857725 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.857827 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.858037 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.858139 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.858347 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.858450 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.858670 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.858787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.858995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.859249 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.859347 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.859609 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.859779 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.859986 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.860158 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.860348 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.860465 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.860689 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.860843 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.861047 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.861255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.861499 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.861690 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.861790 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.862070 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.862290 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.862399 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.862557 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.862823 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.863041 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.863145 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.863313 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.863487 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.863619 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.863777 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.864254 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.864541 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.864654 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.864748 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.864846 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.864946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.865098 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.865285 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.865415 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.865613 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.865731 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.865927 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.866045 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.866235 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.866363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.866688 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.866790 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.867001 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.867110 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.867318 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.867412 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.867632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.867735 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.867965 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.868072 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.868293 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.868390 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.868591 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.868691 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.868903 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.869026 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.869244 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.869350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.869560 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.869655 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.869874 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.869977 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.870188 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.870301 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.870501 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.870596 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.870815 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.870911 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.871123 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.871731 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.871966 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.872208 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.872388 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.872548 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.872749 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.872865 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.873204 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.873324 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.873517 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.873612 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.873849 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.873987 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.874153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.874272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.874465 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.874572 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.874778 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.874879 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.875095 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.875199 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.875413 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.875514 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.875722 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.875815 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.876031 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.876137 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.876341 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.876442 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.876649 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.876750 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.876969 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.877095 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.877311 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.877406 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.877622 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.877732 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.877931 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.878035 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.878248 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.878344 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.878561 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.878672 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.878866 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.878969 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.879182 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.879279 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.879491 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.879595 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.879811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.879905 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.880119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.880224 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.880429 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.880524 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.880739 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.880841 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.881046 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.881242 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.881381 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.881488 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.881686 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.881821 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.882014 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.882144 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.882330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.882455 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.882639 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.882765 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.882946 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.883115 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.883254 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.883380 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.883553 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.883703 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.883861 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.884037 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.884176 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.884361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.884488 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.884674 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.884795 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.884986 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.885108 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.885327 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.885422 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.885719 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.885851 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.886027 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.886166 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.886335 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.886497 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.886647 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.886822 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.887003 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.887309 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.887402 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.887616 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.887718 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.887923 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.888017 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.888228 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.888321 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.888541 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.888654 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.888846 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.888948 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.889180 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.889294 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.889493 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.889614 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.889793 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.889893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.890114 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.890221 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.890425 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.890727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.891045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.891184 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.891352 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.891693 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.891888 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.892118 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.892258 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.892526 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.892663 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.892746 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.892988 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.893099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.893341 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.893451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.893718 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.893901 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.894077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.894359 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.894585 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.894753 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.894917 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.895092 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.895261 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.895422 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.895583 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.895745 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.895900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.896061 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.896228 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.896383 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.896536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.896689 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.896795 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.896899 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.896994 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.897123 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.897227 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.897316 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.897440 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.897639 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.897740 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.897953 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.898047 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.898272 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.898372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.898591 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.898705 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.898910 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.899005 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.899226 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.899326 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.899533 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.899632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.899839 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.899934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.900143 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.900244 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.900446 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.900540 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.900756 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.900849 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.901058 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.901188 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.901407 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.901499 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.901730 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.901832 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.902048 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.902251 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.902350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.902992 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.903223 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.903404 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.903607 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.903722 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.903837 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.903968 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.904145 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.904290 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.904478 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.904590 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.904757 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.904898 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.905093 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.905238 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.905415 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.905682 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.905830 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.906008 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.906152 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.906329 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.906486 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.906637 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.906787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.906936 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.907193 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.907345 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.907528 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.907685 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.907851 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.907995 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.908172 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.908327 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.908502 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.908670 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.908809 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.908952 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.909124 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.909279 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.909430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.909607 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.909748 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.909901 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.910044 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.910267 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.910411 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.910563 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.910713 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.910815 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.910899 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.911096 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.911210 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.911432 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.911588 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.911731 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.911884 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.912025 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.912171 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.912340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.912490 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.912642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.912793 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.912991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.913155 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.913387 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.913544 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.913765 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.913918 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.914059 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.914202 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.914351 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.914494 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.914643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.914881 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.915034 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.915191 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.915331 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.915516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.915618 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.915746 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.915849 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.916060 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.916162 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.916369 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.916472 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.916677 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.916773 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.916986 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.917107 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.917327 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.917496 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.917652 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.917745 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.917961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.918062 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.918788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.918904 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.919212 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.919316 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.919605 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.919699 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.919926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.920030 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.920247 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.920342 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.920557 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.920651 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.920878 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.920974 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.921224 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.921339 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.921536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.921640 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.921856 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.921963 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.922164 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.922260 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.922490 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.922608 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.922827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.922929 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.923154 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.923255 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.923468 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.923579 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.923787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.923931 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.924072 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.924166 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.924371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.924475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.924677 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.924771 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.924994 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.925117 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.925329 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.925463 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.925637 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.925733 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.925939 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.926041 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.926250 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.926345 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.926553 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.926654 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.926855 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.926949 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.927157 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.927269 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.927459 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.927561 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.927764 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.927864 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.928063 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.928158 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.928362 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.928454 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.928662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.928769 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.928960 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.929054 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.929286 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.929383 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.929587 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.929689 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.929893 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.929991 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.930193 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.930296 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.930494 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.930623 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.930794 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.930961 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.931094 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.931278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.931379 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.931625 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.931719 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.931960 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.932064 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.932285 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.932392 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.932603 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.932700 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.932926 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.933020 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.933282 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.933426 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.933594 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.933687 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.934429 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.934525 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.934754 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.934911 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.935075 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.935282 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.935443 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.935585 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.935735 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.935842 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.935981 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.936084 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.936290 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.936385 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.936600 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.936704 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.936910 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.937014 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.937283 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.937378 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.937589 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.937683 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.937914 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.938008 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.938230 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.938330 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.938531 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.938630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.938841 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.938988 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.939154 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.939258 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.939470 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.939563 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.939788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.939909 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.940097 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.940223 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.940423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.940540 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.940733 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.940839 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.941039 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.941179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.941371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.941469 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.941680 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.941784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.941988 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.942098 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.942300 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.942403 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.942610 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.942726 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.942916 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.943021 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.943229 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.943323 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.943540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.943663 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.943862 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.943994 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.944182 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.944294 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.944487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.944732 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.944840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.945067 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.945252 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.945410 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.945514 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.945734 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.945851 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.946057 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.946163 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.946378 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.946490 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.946698 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.946805 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.947008 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.947111 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.947313 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.947433 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.947606 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 04:30:16.947701 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.947935 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.948268 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.948597 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.948960 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.949427 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.950236 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.951645 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.951980 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.952309 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.952714 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.953001 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.953343 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.953669 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.954027 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.954386 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.954765 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.955086 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.955410 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.955949 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.956080 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.956366 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.956687 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.957011 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.957384 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.957732 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.958061 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.958383 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.958706 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.959030 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.959572 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.959896 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.960236 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.960570 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.960899 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.961246 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.961576 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.961909 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.962221 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.962532 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.962852 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.963164 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.963474 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.963801 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.964120 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.964432 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.964759 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.965141 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.965686 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.966042 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.966363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.966695 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.967027 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.967349 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.967661 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.967990 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.968302 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.968615 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.968936 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.969280 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.969593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.969904 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.970221 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.970536 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.970844 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.971163 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.971475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.971813 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.972127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.972438 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.972748 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.973067 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.973398 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.973710 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.974022 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.974331 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.974646 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.974955 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.975361 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.975674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.975993 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.976360 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.976678 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.976989 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.977340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.977654 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.977966 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.978291 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.978608 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.979110 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.979261 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.979553 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.979913 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.980227 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.980801 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.981370 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.981715 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.982055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.982394 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.982710 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.983024 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.983335 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.983666 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.983984 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.984348 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.984618 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.984934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.986832 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.987184 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.987518 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.987850 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.988179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.988506 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.988831 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.989181 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.989504 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.989828 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.990286 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.990508 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.990837 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.991163 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.991489 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.991818 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.992137 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.992457 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.992774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.993107 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.993437 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.993772 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.994093 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.994410 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.994846 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.995165 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.995495 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.995820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.996135 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.996994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.997442 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.997643 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.997971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.998291 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.998620 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.998967 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.999415 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.999660 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:16.999972 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.000285 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.000594 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.001029 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.001269 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.001588 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.001899 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.002214 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.002531 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.002860 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.003148 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.003461 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.003767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.004080 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.004389 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.004692 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.004999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.005356 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.005664 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.005973 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.006288 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.006595 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.006908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.007214 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.007520 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.007825 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.008159 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.008497 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.008819 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.009197 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.009516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.009842 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.010160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.010488 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.010819 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.011145 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.011464 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.011804 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.012662 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.012985 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.013340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.013448 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO dbcounter [None req-5063d2af-8646-4090-bddc-c9a82bc6440c None None] Registered counter for database nova_api Oct 17 04:30:17.013661 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.013977 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.014291 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.014699 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.014959 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.015273 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.015599 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.015924 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.016251 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.016572 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.016900 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.017248 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.017565 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.017896 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.018199 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.018516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.018832 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.019322 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.019495 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.019768 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.020093 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.020431 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.020750 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.021065 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.021396 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.021731 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.022061 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.022420 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.022738 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.023094 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.023429 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.023748 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.024067 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.024379 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 04:30:17.024626 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 04:30:17.036378 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_db.sqlalchemy.engines [None req-5063d2af-8646-4090-bddc-c9a82bc6440c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 04:30:17.043195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writer thread running {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 04:30:17.088399 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO dbcounter [None req-5c11329c-4f98-47fb-b51d-97c15e96df48 None None] Registered counter for database nova_api Oct 17 04:30:17.100198 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.context [None req-5063d2af-8646-4090-bddc-c9a82bc6440c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfb5b667-bbe0-47ae-a932-3b61872d8f9d(cell1) {{(pid=119127) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 04:30:17.104611 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5063d2af-8646-4090-bddc-c9a82bc6440c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:30:17.105391 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5063d2af-8646-4090-bddc-c9a82bc6440c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:30:17.107503 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5063d2af-8646-4090-bddc-c9a82bc6440c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:30:17.108489 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5063d2af-8646-4090-bddc-c9a82bc6440c None None] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:30:17.109175 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5063d2af-8646-4090-bddc-c9a82bc6440c None None] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:30:17.110240 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_db.sqlalchemy.engines [None req-5c11329c-4f98-47fb-b51d-97c15e96df48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 04:30:17.111452 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5063d2af-8646-4090-bddc-c9a82bc6440c None None] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:30:17.113521 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO dbcounter [None req-5063d2af-8646-4090-bddc-c9a82bc6440c None None] Registered counter for database nova_cell0 Oct 17 04:30:17.117393 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writer thread running {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 04:30:17.117664 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO dbcounter [None req-5063d2af-8646-4090-bddc-c9a82bc6440c None None] Registered counter for database nova_cell1 Oct 17 04:30:17.125144 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_db.sqlalchemy.engines [None req-5063d2af-8646-4090-bddc-c9a82bc6440c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 04:30:17.130957 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writer thread running {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 04:30:17.131612 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_db.sqlalchemy.engines [None req-5063d2af-8646-4090-bddc-c9a82bc6440c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 04:30:17.175989 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.context [None req-5c11329c-4f98-47fb-b51d-97c15e96df48 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bfb5b667-bbe0-47ae-a932-3b61872d8f9d(cell1) {{(pid=119128) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 04:30:17.180083 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c11329c-4f98-47fb-b51d-97c15e96df48 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:30:17.180567 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c11329c-4f98-47fb-b51d-97c15e96df48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:30:17.182199 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c11329c-4f98-47fb-b51d-97c15e96df48 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:30:17.182945 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c11329c-4f98-47fb-b51d-97c15e96df48 None None] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:30:17.183398 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c11329c-4f98-47fb-b51d-97c15e96df48 None None] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:30:17.185529 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c11329c-4f98-47fb-b51d-97c15e96df48 None None] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:30:17.187557 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO dbcounter [None req-5c11329c-4f98-47fb-b51d-97c15e96df48 None None] Registered counter for database nova_cell0 Oct 17 04:30:17.191773 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO dbcounter [None req-5c11329c-4f98-47fb-b51d-97c15e96df48 None None] Registered counter for database nova_cell1 Oct 17 04:30:17.201733 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_db.sqlalchemy.engines [None req-5c11329c-4f98-47fb-b51d-97c15e96df48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 04:30:17.202965 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_db.sqlalchemy.engines [None req-5c11329c-4f98-47fb-b51d-97c15e96df48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 04:30:17.209570 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writer thread running {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 04:30:17.277306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writer thread running {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 04:30:17.288563 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO dbcounter [None req-5063d2af-8646-4090-bddc-c9a82bc6440c None None] Registered counter for database nova_cell0 Oct 17 04:30:17.294596 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_db.sqlalchemy.engines [None req-5063d2af-8646-4090-bddc-c9a82bc6440c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 04:30:17.299263 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writer thread running {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 04:30:17.354393 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writer thread running {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 04:30:17.365480 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO dbcounter [None req-5c11329c-4f98-47fb-b51d-97c15e96df48 None None] Registered counter for database nova_cell0 Oct 17 04:30:17.373599 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_db.sqlalchemy.engines [None req-5c11329c-4f98-47fb-b51d-97c15e96df48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 04:30:17.378586 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writer thread running {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 04:30:17.628189 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: WARNING keystonemiddleware.auth_token [None req-5063d2af-8646-4090-bddc-c9a82bc6440c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 04:30:17.636981 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: WARNING keystonemiddleware.auth_token [None req-5063d2af-8646-4090-bddc-c9a82bc6440c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 04:30:17.724322 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: WARNING keystonemiddleware.auth_token [None req-5c11329c-4f98-47fb-b51d-97c15e96df48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 04:30:17.732507 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: WARNING keystonemiddleware.auth_token [None req-5c11329c-4f98-47fb-b51d-97c15e96df48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 04:30:17.998240 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: WARNING keystonemiddleware.auth_token [None req-5063d2af-8646-4090-bddc-c9a82bc6440c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 04:30:18.004331 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: WARNING keystonemiddleware.auth_token [None req-5063d2af-8646-4090-bddc-c9a82bc6440c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 04:30:18.009724 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557a39d959c0 pid: 119127 (default app) Oct 17 04:30:18.077429 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: WARNING keystonemiddleware.auth_token [None req-5c11329c-4f98-47fb-b51d-97c15e96df48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 04:30:18.083428 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: WARNING keystonemiddleware.auth_token [None req-5c11329c-4f98-47fb-b51d-97c15e96df48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 04:30:18.088755 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557a39d959c0 pid: 119128 (default app) Oct 17 04:31:07.603095 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:07.606393 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:07.607525 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:07.609354 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:09.419736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ec9fddb-7356-449c-9355-73a98de83cea tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1988421079", "imageRef": "bf655d8c-fb2f-42ef-a7a7-0386f57b58cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:10.010374 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:10.012620 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:10.013909 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:10.015051 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:10.332236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-9ec9fddb-7356-449c-9355-73a98de83cea tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] validate_networks() for [('4ce7fcf6-47cd-4a5b-9f10-a91cb1036deb', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:31:10.726968 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6113c07d-3d9d-47f5-bc40-1132eacfaac0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2032338045", "imageRef": "bf655d8c-fb2f-42ef-a7a7-0386f57b58cf", "flavorRef": "452", "networks": [{"uuid": "8500cc6f-85c4-44a2-bb52-3bb418fbfad7"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:11.286007 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-6113c07d-3d9d-47f5-bc40-1132eacfaac0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] validate_networks() for [('8500cc6f-85c4-44a2-bb52-3bb418fbfad7', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:31:12.757356 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9ec9fddb-7356-449c-9355-73a98de83cea tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:31:12.757884 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9ec9fddb-7356-449c-9355-73a98de83cea tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:31:12.758383 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9ec9fddb-7356-449c-9355-73a98de83cea tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:31:12.758798 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9ec9fddb-7356-449c-9355-73a98de83cea tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:31:12.759210 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-9ec9fddb-7356-449c-9355-73a98de83cea tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:31:12.805397 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ec9fddb-7356-449c-9355-73a98de83cea tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:12.806264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ec9fddb-7356-449c-9355-73a98de83cea tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:12.806359 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ec9fddb-7356-449c-9355-73a98de83cea tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:12.807134 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ec9fddb-7356-449c-9355-73a98de83cea tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:12.813769 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ec9fddb-7356-449c-9355-73a98de83cea tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:12.814698 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ec9fddb-7356-449c-9355-73a98de83cea tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:12.907837 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-9ec9fddb-7356-449c-9355-73a98de83cea tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Getting quotas for project 7bd6234b23704bdf809481085ce465eb. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:31:12.934656 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-9ec9fddb-7356-449c-9355-73a98de83cea tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Getting quotas for user 308c01bc66224188aec055c2397a066b and project 7bd6234b23704bdf809481085ce465eb. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:31:12.975332 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9ec9fddb-7356-449c-9355-73a98de83cea tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:31:12.981357 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9ec9fddb-7356-449c-9355-73a98de83cea tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf655d8c-fb2f-42ef-a7a7-0386f57b58cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:31:13.173904 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9ec9fddb-7356-449c-9355-73a98de83cea tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.583967 Oct 17 04:31:13.177699 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:31:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 5590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 04:31:13.333869 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ec1ab84c-4de5-4b0c-b162-1523239b3288 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Action: 'create', calling method: .version_select at 0x7fc6313ac4c0>, body: {"keypair": {"name": "tempest-keypair-1214594123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgVsnEZIvZLCjGHhrxKzCCwCJJyFAJ3IsGxrcuEwKMj05gtMmLotQcSE1pCw6UGruZopcdY7v0Whb9eyKQs7bye+o2SVkPpb0qKXlyXOD3jsKhsCSrv/G22ZxVSYFxxrg=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:13.424717 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-ec1ab84c-4de5-4b0c-b162-1523239b3288 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Getting quotas for project 0761fde06e5240adb0d7f1a7d5724d37. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:31:13.438843 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-ec1ab84c-4de5-4b0c-b162-1523239b3288 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Getting quotas for user c7ea83c1a5d34727943721cd91e7268d and project 0761fde06e5240adb0d7f1a7d5724d37. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:31:13.456537 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6113c07d-3d9d-47f5-bc40-1132eacfaac0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:31:13.457068 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6113c07d-3d9d-47f5-bc40-1132eacfaac0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:31:13.458912 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6113c07d-3d9d-47f5-bc40-1132eacfaac0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:31:13.459734 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6113c07d-3d9d-47f5-bc40-1132eacfaac0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:31:13.460974 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-6113c07d-3d9d-47f5-bc40-1132eacfaac0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:31:13.533598 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6113c07d-3d9d-47f5-bc40-1132eacfaac0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:13.534886 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6113c07d-3d9d-47f5-bc40-1132eacfaac0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:13.540992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6113c07d-3d9d-47f5-bc40-1132eacfaac0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:13.545957 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6113c07d-3d9d-47f5-bc40-1132eacfaac0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:13.546702 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6113c07d-3d9d-47f5-bc40-1132eacfaac0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:13.547970 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6113c07d-3d9d-47f5-bc40-1132eacfaac0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:13.591519 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ec1ab84c-4de5-4b0c-b162-1523239b3288 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.412153 Oct 17 04:31:13.592179 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 2/2] 10.222.0.40 () {62 vars in 1200 bytes} [Mon Oct 17 04:31:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 414 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 04:31:13.610352 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f9953f5f-fe1d-48ad-8a26-f4500eaadb68 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:13.613842 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f9953f5f-fe1d-48ad-8a26-f4500eaadb68 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:13.673338 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-6113c07d-3d9d-47f5-bc40-1132eacfaac0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Getting quotas for project e5eb02a1b40e4b83bc6baf4c3ac1bbbf. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:31:13.698899 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-6113c07d-3d9d-47f5-bc40-1132eacfaac0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Getting quotas for user 34187140ebf44707a37b082b4d5676eb and project e5eb02a1b40e4b83bc6baf4c3ac1bbbf. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:31:13.770106 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6113c07d-3d9d-47f5-bc40-1132eacfaac0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:31:13.794329 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6113c07d-3d9d-47f5-bc40-1132eacfaac0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf655d8c-fb2f-42ef-a7a7-0386f57b58cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:31:13.950839 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f9953f5f-fe1d-48ad-8a26-f4500eaadb68 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:14.056207 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f9953f5f-fe1d-48ad-8a26-f4500eaadb68 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1222 microversion: 2.1 time: 0.458527 Oct 17 04:31:14.056746 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 3/3] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:13 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1222 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:14.074699 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6113c07d-3d9d-47f5-bc40-1132eacfaac0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.079042 Oct 17 04:31:14.082063 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 1/4] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:31:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 4093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 04:31:14.099970 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3dbf697a-8cdc-4e27-ac81-b91003061bc6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:14.100590 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3dbf697a-8cdc-4e27-ac81-b91003061bc6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:14.299946 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3dbf697a-8cdc-4e27-ac81-b91003061bc6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:14.350744 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3dbf697a-8cdc-4e27-ac81-b91003061bc6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1215 microversion: 2.1 time: 0.263618 Oct 17 04:31:14.368031 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 2/5] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:14 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1215 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:31:14.970190 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3ba11632-a097-4c0a-bf81-76b847764f16 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Action: 'create', calling method: .version_select at 0x7fc6313044c0>, body: {"keypair": {"name": "tempest-keypair-1771476207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjQ5FyUY2rcUe+DZCzUU/WDO3PXDCFmR6gNCf3xd+yNR9f/g5xARkRDjY7h5mEbNGOJfqJ+SabkI6kr9F/NvAbP/JFMGmbXcIofmwQ3XAe7nMJxha3RxPMT+58d9eYtHQ=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:15.021717 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-3ba11632-a097-4c0a-bf81-76b847764f16 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Getting quotas for project 9de6141e0c3a41bcb84ac635b48a51df. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:31:15.058026 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-3ba11632-a097-4c0a-bf81-76b847764f16 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Getting quotas for user 78eac67939a44d0fa99cb748b56f7b70 and project 9de6141e0c3a41bcb84ac635b48a51df. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:31:15.114142 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3ba11632-a097-4c0a-bf81-76b847764f16 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.844450 Oct 17 04:31:15.118073 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 4/6] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Oct 17 04:31:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:31:15.137062 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bf1347e8-3a38-4461-8e3e-babe43521671 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1964080656", "imageRef": "bf655d8c-fb2f-42ef-a7a7-0386f57b58cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:15.140197 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-29e050a9-3d89-4a30-82b9-8e2c4fa091dc tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Action: 'create', calling method: .version_select at 0x7fc63134a790>, body: {"keypair": {"name": "tempest-keypair-200940111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmSUV8dJ/w1uSOwHTDEs6wsJqGmEHtdbhu/bgD2AUbe3HR3rMa3JUuAF+GkC3lMfuc/vl83aiMrV1IJJGBjdHFbV2O3djsUmhyZnn8P+4jGQ+0j2+leyOUlwxwaw/Cmqw=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:15.200261 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-29e050a9-3d89-4a30-82b9-8e2c4fa091dc tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Getting quotas for project e022e6125e85417881ce226db7a5c764. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:31:15.221261 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-29e050a9-3d89-4a30-82b9-8e2c4fa091dc tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Getting quotas for user 59aa96241a8e4d9db6d255c38f618ca1 and project e022e6125e85417881ce226db7a5c764. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:31:15.280199 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-bf1347e8-3a38-4461-8e3e-babe43521671 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] validate_networks() for [('4ce7fcf6-47cd-4a5b-9f10-a91cb1036deb', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:31:15.354577 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-29e050a9-3d89-4a30-82b9-8e2c4fa091dc tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.979906 Oct 17 04:31:15.356028 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 3/7] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Oct 17 04:31:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:31:15.386801 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3187f36e-3e04-4f86-8c64-a11773d47f5c tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:15.388871 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3187f36e-3e04-4f86-8c64-a11773d47f5c tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:15.681344 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3187f36e-3e04-4f86-8c64-a11773d47f5c tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:15.710373 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3187f36e-3e04-4f86-8c64-a11773d47f5c tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1215 microversion: 2.1 time: 0.329988 Oct 17 04:31:15.711267 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:15 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1215 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:16.416279 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-bf1347e8-3a38-4461-8e3e-babe43521671 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:31:16.417716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-bf1347e8-3a38-4461-8e3e-babe43521671 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:31:16.418486 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-bf1347e8-3a38-4461-8e3e-babe43521671 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:31:16.419185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-bf1347e8-3a38-4461-8e3e-babe43521671 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:31:16.419762 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-bf1347e8-3a38-4461-8e3e-babe43521671 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:31:16.429747 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf1347e8-3a38-4461-8e3e-babe43521671 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:16.430465 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf1347e8-3a38-4461-8e3e-babe43521671 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:16.431060 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf1347e8-3a38-4461-8e3e-babe43521671 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:16.431941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf1347e8-3a38-4461-8e3e-babe43521671 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:16.432776 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf1347e8-3a38-4461-8e3e-babe43521671 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:16.433464 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf1347e8-3a38-4461-8e3e-babe43521671 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:16.453918 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-bf1347e8-3a38-4461-8e3e-babe43521671 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Getting quotas for project 7bd6234b23704bdf809481085ce465eb. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:31:16.462407 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-bf1347e8-3a38-4461-8e3e-babe43521671 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Getting quotas for user 308c01bc66224188aec055c2397a066b and project 7bd6234b23704bdf809481085ce465eb. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:31:16.475599 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bf1347e8-3a38-4461-8e3e-babe43521671 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:31:16.478104 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bf1347e8-3a38-4461-8e3e-babe43521671 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf655d8c-fb2f-42ef-a7a7-0386f57b58cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:31:16.546299 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bf1347e8-3a38-4461-8e3e-babe43521671 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.415956 Oct 17 04:31:16.547218 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 5/9] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:31:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 1418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 04:31:16.559001 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-98da6a20-85c6-4bbd-86a2-c646fa4ed4f1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:16.559547 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-98da6a20-85c6-4bbd-86a2-c646fa4ed4f1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:16.692033 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-98da6a20-85c6-4bbd-86a2-c646fa4ed4f1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:16.701345 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-98da6a20-85c6-4bbd-86a2-c646fa4ed4f1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1222 microversion: 2.1 time: 0.146583 Oct 17 04:31:16.702191 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 5/10] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:16 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1222 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:31:16.735557 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5f804673-d8d7-498d-83c7-3a553e721a8c tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:16.736615 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5f804673-d8d7-498d-83c7-3a553e721a8c tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:16.747031 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f804673-d8d7-498d-83c7-3a553e721a8c tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:16.749042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f804673-d8d7-498d-83c7-3a553e721a8c tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:16.749964 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f804673-d8d7-498d-83c7-3a553e721a8c tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:16.751292 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f804673-d8d7-498d-83c7-3a553e721a8c tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:16.752025 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f804673-d8d7-498d-83c7-3a553e721a8c tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:16.752638 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f804673-d8d7-498d-83c7-3a553e721a8c tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:17.252707 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5f804673-d8d7-498d-83c7-3a553e721a8c tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:17.297343 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5f804673-d8d7-498d-83c7-3a553e721a8c tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1219 microversion: 2.1 time: 0.563342 Oct 17 04:31:17.298325 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 6/11] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:16 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1219 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:17.729438 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a80bccd9-a65c-462b-b1c4-44d8f66a0ec4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:17.730210 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a80bccd9-a65c-462b-b1c4-44d8f66a0ec4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:17.747648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a80bccd9-a65c-462b-b1c4-44d8f66a0ec4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:17.748151 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a80bccd9-a65c-462b-b1c4-44d8f66a0ec4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:17.748596 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a80bccd9-a65c-462b-b1c4-44d8f66a0ec4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:17.749341 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a80bccd9-a65c-462b-b1c4-44d8f66a0ec4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:17.749798 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a80bccd9-a65c-462b-b1c4-44d8f66a0ec4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:17.750236 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a80bccd9-a65c-462b-b1c4-44d8f66a0ec4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:18.053388 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-a80bccd9-a65c-462b-b1c4-44d8f66a0ec4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:18.075446 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a80bccd9-a65c-462b-b1c4-44d8f66a0ec4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1226 microversion: 2.1 time: 0.352927 Oct 17 04:31:18.076605 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:17 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1226 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:18.332370 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-70368818-b0af-4399-82c6-fcefae7bd4a9 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:18.333938 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-70368818-b0af-4399-82c6-fcefae7bd4a9 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:18.357176 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a736e6e1-8221-45b2-b6c5-d9f281a45aa0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1840092405", "imageRef": "bf655d8c-fb2f-42ef-a7a7-0386f57b58cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "596ebb0d-79d0-45f5-9e52-b2ce25b00863"}], "security_groups": [{"name": "tempest-securitygroup--269664804"}], "key_name": "tempest-keypair-1214594123", "user_data": "}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:18.367336 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70368818-b0af-4399-82c6-fcefae7bd4a9 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:18.378320 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70368818-b0af-4399-82c6-fcefae7bd4a9 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:18.378825 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70368818-b0af-4399-82c6-fcefae7bd4a9 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:18.379600 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70368818-b0af-4399-82c6-fcefae7bd4a9 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:18.380081 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70368818-b0af-4399-82c6-fcefae7bd4a9 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:18.380522 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70368818-b0af-4399-82c6-fcefae7bd4a9 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:18.919217 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-70368818-b0af-4399-82c6-fcefae7bd4a9 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:18.934912 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-70368818-b0af-4399-82c6-fcefae7bd4a9 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1267 microversion: 2.1 time: 0.611604 Oct 17 04:31:18.938526 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:18 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1267 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:19.099974 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-a736e6e1-8221-45b2-b6c5-d9f281a45aa0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] validate_networks() for [('596ebb0d-79d0-45f5-9e52-b2ce25b00863', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:31:19.105058 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aca5d160-c5c1-4121-a781-fead64369bda tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:19.106499 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aca5d160-c5c1-4121-a781-fead64369bda tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:19.123821 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aca5d160-c5c1-4121-a781-fead64369bda tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:19.124582 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aca5d160-c5c1-4121-a781-fead64369bda tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:19.125338 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aca5d160-c5c1-4121-a781-fead64369bda tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:19.130546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aca5d160-c5c1-4121-a781-fead64369bda tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:19.131252 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aca5d160-c5c1-4121-a781-fead64369bda tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:19.133060 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aca5d160-c5c1-4121-a781-fead64369bda tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:19.831695 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-aca5d160-c5c1-4121-a781-fead64369bda tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:19.846928 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aca5d160-c5c1-4121-a781-fead64369bda tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1218 microversion: 2.1 time: 0.750177 Oct 17 04:31:19.866579 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 8/14] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:19 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1218 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:19.960646 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fcf820a5-1502-4083-8b41-b3fb311682db tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:19.961821 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fcf820a5-1502-4083-8b41-b3fb311682db tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:19.971306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fcf820a5-1502-4083-8b41-b3fb311682db tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:19.972497 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fcf820a5-1502-4083-8b41-b3fb311682db tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:19.974451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fcf820a5-1502-4083-8b41-b3fb311682db tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:19.976159 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fcf820a5-1502-4083-8b41-b3fb311682db tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:19.976849 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fcf820a5-1502-4083-8b41-b3fb311682db tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:19.977536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fcf820a5-1502-4083-8b41-b3fb311682db tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:20.196182 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-fcf820a5-1502-4083-8b41-b3fb311682db tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:20.208389 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fcf820a5-1502-4083-8b41-b3fb311682db tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1273 microversion: 2.1 time: 0.253324 Oct 17 04:31:20.211858 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 9/15] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:19 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:20.879990 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2e65f37b-a57b-4836-b01b-fd875e8e63a9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:20.881642 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2e65f37b-a57b-4836-b01b-fd875e8e63a9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:20.898884 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e65f37b-a57b-4836-b01b-fd875e8e63a9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:20.903831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e65f37b-a57b-4836-b01b-fd875e8e63a9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:20.904507 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e65f37b-a57b-4836-b01b-fd875e8e63a9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:20.905433 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e65f37b-a57b-4836-b01b-fd875e8e63a9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:20.906769 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e65f37b-a57b-4836-b01b-fd875e8e63a9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:20.907575 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e65f37b-a57b-4836-b01b-fd875e8e63a9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:21.172872 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-2e65f37b-a57b-4836-b01b-fd875e8e63a9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:21.184209 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2e65f37b-a57b-4836-b01b-fd875e8e63a9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1274 microversion: 2.1 time: 0.313985 Oct 17 04:31:21.190141 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 10/16] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:20 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1274 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:21.234220 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a736e6e1-8221-45b2-b6c5-d9f281a45aa0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:31:21.235689 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a736e6e1-8221-45b2-b6c5-d9f281a45aa0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:31:21.236183 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a736e6e1-8221-45b2-b6c5-d9f281a45aa0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:31:21.236604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a736e6e1-8221-45b2-b6c5-d9f281a45aa0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:31:21.237025 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a736e6e1-8221-45b2-b6c5-d9f281a45aa0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:31:21.238200 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4c23be09-fc95-4d55-b80e-7b1b8fe8f05e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2016562125", "imageRef": "bf655d8c-fb2f-42ef-a7a7-0386f57b58cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b651c35-159b-4d6e-a364-6761b8b7e75b"}], "security_groups": [{"name": "tempest-securitygroup--498767629"}], "key_name": "tempest-keypair-1771476207", "user_data": "}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:21.249598 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a736e6e1-8221-45b2-b6c5-d9f281a45aa0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:21.250100 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a736e6e1-8221-45b2-b6c5-d9f281a45aa0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:21.252174 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a736e6e1-8221-45b2-b6c5-d9f281a45aa0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:21.252982 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a736e6e1-8221-45b2-b6c5-d9f281a45aa0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:21.253508 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a736e6e1-8221-45b2-b6c5-d9f281a45aa0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:21.254037 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a736e6e1-8221-45b2-b6c5-d9f281a45aa0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:21.279615 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-a736e6e1-8221-45b2-b6c5-d9f281a45aa0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Getting quotas for project 0761fde06e5240adb0d7f1a7d5724d37. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:31:21.284357 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-a736e6e1-8221-45b2-b6c5-d9f281a45aa0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Getting quotas for user c7ea83c1a5d34727943721cd91e7268d and project 0761fde06e5240adb0d7f1a7d5724d37. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:31:21.298365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a736e6e1-8221-45b2-b6c5-d9f281a45aa0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:31:21.300773 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a736e6e1-8221-45b2-b6c5-d9f281a45aa0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf655d8c-fb2f-42ef-a7a7-0386f57b58cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:31:21.419039 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-4c23be09-fc95-4d55-b80e-7b1b8fe8f05e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] validate_networks() for [('5b651c35-159b-4d6e-a364-6761b8b7e75b', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:31:21.424668 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a736e6e1-8221-45b2-b6c5-d9f281a45aa0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.070513 Oct 17 04:31:21.427912 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 7/17] 10.222.0.40 () {62 vars in 1188 bytes} [Mon Oct 17 04:31:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 3078 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 04:31:21.457981 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d5ec1e08-d838-4eab-964b-33fe1fb4a72d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:21.462215 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d5ec1e08-d838-4eab-964b-33fe1fb4a72d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:21.480515 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5ec1e08-d838-4eab-964b-33fe1fb4a72d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:21.498617 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5ec1e08-d838-4eab-964b-33fe1fb4a72d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:21.501706 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5ec1e08-d838-4eab-964b-33fe1fb4a72d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:21.506156 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5ec1e08-d838-4eab-964b-33fe1fb4a72d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:21.507245 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5ec1e08-d838-4eab-964b-33fe1fb4a72d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:21.508580 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5ec1e08-d838-4eab-964b-33fe1fb4a72d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:21.763485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d5ec1e08-d838-4eab-964b-33fe1fb4a72d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:21.772171 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d5ec1e08-d838-4eab-964b-33fe1fb4a72d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1273 microversion: 2.1 time: 0.334541 Oct 17 04:31:21.775201 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 8/18] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:21 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1273 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:21.794311 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8af31434-b17a-4e53-a360-f39f5a3ebd28 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:21.801777 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8af31434-b17a-4e53-a360-f39f5a3ebd28 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:22.023613 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-8af31434-b17a-4e53-a360-f39f5a3ebd28 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:22.116172 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-8af31434-b17a-4e53-a360-f39f5a3ebd28 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:22.121894 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-8af31434-b17a-4e53-a360-f39f5a3ebd28 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:22.133633 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8af31434-b17a-4e53-a360-f39f5a3ebd28 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1282 microversion: 2.20 time: 0.356547 Oct 17 04:31:22.146099 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 9/19] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:31:21 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1282 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:31:22.170683 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1f1d8699-39e3-401b-89fa-410069efe3d0 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2059438609", "imageRef": "bf655d8c-fb2f-42ef-a7a7-0386f57b58cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60b2c529-82f9-47ea-9951-24ba7b38ebc9"}], "security_groups": [{"name": "tempest-securitygroup--344527414"}], "key_name": "tempest-keypair-200940111", "user_data": "}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:22.631010 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4c23be09-fc95-4d55-b80e-7b1b8fe8f05e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:31:22.631624 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4c23be09-fc95-4d55-b80e-7b1b8fe8f05e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:31:22.632202 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4c23be09-fc95-4d55-b80e-7b1b8fe8f05e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:31:22.632320 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4c23be09-fc95-4d55-b80e-7b1b8fe8f05e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:31:22.632737 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-4c23be09-fc95-4d55-b80e-7b1b8fe8f05e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:31:22.666885 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c23be09-fc95-4d55-b80e-7b1b8fe8f05e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:22.667438 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c23be09-fc95-4d55-b80e-7b1b8fe8f05e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:22.680023 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c23be09-fc95-4d55-b80e-7b1b8fe8f05e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:22.686012 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c23be09-fc95-4d55-b80e-7b1b8fe8f05e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:22.687450 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c23be09-fc95-4d55-b80e-7b1b8fe8f05e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:22.690138 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4c23be09-fc95-4d55-b80e-7b1b8fe8f05e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:22.816678 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-4c23be09-fc95-4d55-b80e-7b1b8fe8f05e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Getting quotas for project 9de6141e0c3a41bcb84ac635b48a51df. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:31:22.822368 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-1f1d8699-39e3-401b-89fa-410069efe3d0 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] validate_networks() for [('60b2c529-82f9-47ea-9951-24ba7b38ebc9', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:31:22.852571 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-4c23be09-fc95-4d55-b80e-7b1b8fe8f05e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Getting quotas for user 78eac67939a44d0fa99cb748b56f7b70 and project 9de6141e0c3a41bcb84ac635b48a51df. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:31:22.963937 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4c23be09-fc95-4d55-b80e-7b1b8fe8f05e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:31:22.993285 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4c23be09-fc95-4d55-b80e-7b1b8fe8f05e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf655d8c-fb2f-42ef-a7a7-0386f57b58cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:31:23.279853 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4c23be09-fc95-4d55-b80e-7b1b8fe8f05e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.046206 Oct 17 04:31:23.296773 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:31:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 2058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 04:31:23.311549 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b2ace95a-66f4-4b41-83f9-b92e670e8728 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:23.314020 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b2ace95a-66f4-4b41-83f9-b92e670e8728 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:23.330122 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2ace95a-66f4-4b41-83f9-b92e670e8728 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:23.331948 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2ace95a-66f4-4b41-83f9-b92e670e8728 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:23.340526 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2ace95a-66f4-4b41-83f9-b92e670e8728 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:23.343519 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2ace95a-66f4-4b41-83f9-b92e670e8728 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:23.349940 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2ace95a-66f4-4b41-83f9-b92e670e8728 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:23.368930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b2ace95a-66f4-4b41-83f9-b92e670e8728 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:23.732795 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b2ace95a-66f4-4b41-83f9-b92e670e8728 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:23.744855 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b2ace95a-66f4-4b41-83f9-b92e670e8728 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1280 microversion: 2.1 time: 0.457052 Oct 17 04:31:23.746187 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 12/21] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:23 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1280 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:23.764983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b75e73df-b71d-4319-bdab-003dd8306187 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:23.766064 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b75e73df-b71d-4319-bdab-003dd8306187 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:23.774122 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b75e73df-b71d-4319-bdab-003dd8306187 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:23.774699 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b75e73df-b71d-4319-bdab-003dd8306187 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:23.775295 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b75e73df-b71d-4319-bdab-003dd8306187 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:23.777933 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b75e73df-b71d-4319-bdab-003dd8306187 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:23.778515 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b75e73df-b71d-4319-bdab-003dd8306187 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:23.779129 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b75e73df-b71d-4319-bdab-003dd8306187 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:24.316721 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b75e73df-b71d-4319-bdab-003dd8306187 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:24.338358 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b75e73df-b71d-4319-bdab-003dd8306187 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1273 microversion: 2.1 time: 0.590238 Oct 17 04:31:24.340186 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 13/22] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:23 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1273 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:24.367945 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-72194427-e781-4e77-b4c3-9b070179c3cc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:24.368529 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-72194427-e781-4e77-b4c3-9b070179c3cc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:24.374965 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72194427-e781-4e77-b4c3-9b070179c3cc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:24.375595 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72194427-e781-4e77-b4c3-9b070179c3cc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:24.376394 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72194427-e781-4e77-b4c3-9b070179c3cc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:24.378094 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72194427-e781-4e77-b4c3-9b070179c3cc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:24.379304 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72194427-e781-4e77-b4c3-9b070179c3cc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:24.379830 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72194427-e781-4e77-b4c3-9b070179c3cc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:24.939799 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-72194427-e781-4e77-b4c3-9b070179c3cc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:24.965251 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-72194427-e781-4e77-b4c3-9b070179c3cc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:24.984663 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-72194427-e781-4e77-b4c3-9b070179c3cc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:24.989811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-72194427-e781-4e77-b4c3-9b070179c3cc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1334 microversion: 2.20 time: 0.630336 Oct 17 04:31:24.995836 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 14/23] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:31:24 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1334 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:31:25.015927 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d93b14ad-3c4a-4eb2-9aad-85206f451f6c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:25.022493 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d93b14ad-3c4a-4eb2-9aad-85206f451f6c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:25.047842 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d93b14ad-3c4a-4eb2-9aad-85206f451f6c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:25.048563 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d93b14ad-3c4a-4eb2-9aad-85206f451f6c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:25.049506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d93b14ad-3c4a-4eb2-9aad-85206f451f6c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:25.051878 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d93b14ad-3c4a-4eb2-9aad-85206f451f6c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:25.057143 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d93b14ad-3c4a-4eb2-9aad-85206f451f6c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:25.057896 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d93b14ad-3c4a-4eb2-9aad-85206f451f6c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:25.842159 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-d93b14ad-3c4a-4eb2-9aad-85206f451f6c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:25.852787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d93b14ad-3c4a-4eb2-9aad-85206f451f6c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1242 microversion: 2.1 time: 0.849536 Oct 17 04:31:25.855633 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 15/24] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:25 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1242 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:25.865934 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-891053e9-4560-4ec3-b0ab-25a84bfc19a0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:25.869370 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-891053e9-4560-4ec3-b0ab-25a84bfc19a0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:25.883426 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-891053e9-4560-4ec3-b0ab-25a84bfc19a0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:25.883426 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-891053e9-4560-4ec3-b0ab-25a84bfc19a0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:25.883426 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-891053e9-4560-4ec3-b0ab-25a84bfc19a0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:25.883426 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-891053e9-4560-4ec3-b0ab-25a84bfc19a0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:25.884671 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-891053e9-4560-4ec3-b0ab-25a84bfc19a0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:25.884671 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-891053e9-4560-4ec3-b0ab-25a84bfc19a0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:25.957928 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-1f1d8699-39e3-401b-89fa-410069efe3d0 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:31:25.958511 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-1f1d8699-39e3-401b-89fa-410069efe3d0 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:31:25.958957 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-1f1d8699-39e3-401b-89fa-410069efe3d0 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:31:25.959375 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-1f1d8699-39e3-401b-89fa-410069efe3d0 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:31:25.959974 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-1f1d8699-39e3-401b-89fa-410069efe3d0 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:31:25.975576 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f1d8699-39e3-401b-89fa-410069efe3d0 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:25.977311 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f1d8699-39e3-401b-89fa-410069efe3d0 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:25.978120 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f1d8699-39e3-401b-89fa-410069efe3d0 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:25.980272 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f1d8699-39e3-401b-89fa-410069efe3d0 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:25.981892 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f1d8699-39e3-401b-89fa-410069efe3d0 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:25.982677 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f1d8699-39e3-401b-89fa-410069efe3d0 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:26.051680 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-1f1d8699-39e3-401b-89fa-410069efe3d0 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Getting quotas for project e022e6125e85417881ce226db7a5c764. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:31:26.067547 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-1f1d8699-39e3-401b-89fa-410069efe3d0 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Getting quotas for user 59aa96241a8e4d9db6d255c38f618ca1 and project e022e6125e85417881ce226db7a5c764. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:31:26.077426 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-891053e9-4560-4ec3-b0ab-25a84bfc19a0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:26.085698 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1f1d8699-39e3-401b-89fa-410069efe3d0 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:31:26.088449 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1f1d8699-39e3-401b-89fa-410069efe3d0 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf655d8c-fb2f-42ef-a7a7-0386f57b58cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:31:26.091294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-891053e9-4560-4ec3-b0ab-25a84bfc19a0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1280 microversion: 2.1 time: 0.234338 Oct 17 04:31:26.092742 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 16/25] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:25 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1280 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:26.098710 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bea0f801-186c-4544-a029-afccffee7408 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:26.099629 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bea0f801-186c-4544-a029-afccffee7408 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:26.106065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:26.110062 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bea0f801-186c-4544-a029-afccffee7408 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:26.110908 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bea0f801-186c-4544-a029-afccffee7408 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:26.111512 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bea0f801-186c-4544-a029-afccffee7408 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:26.112390 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bea0f801-186c-4544-a029-afccffee7408 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:26.113043 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bea0f801-186c-4544-a029-afccffee7408 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:26.113768 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bea0f801-186c-4544-a029-afccffee7408 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:26.196354 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1f1d8699-39e3-401b-89fa-410069efe3d0 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.046260 Oct 17 04:31:26.201249 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 10/26] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:31:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 4054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 04:31:26.211790 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-88042f85-0df9-47c9-83bd-279c0250fb69 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:26.215340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-88042f85-0df9-47c9-83bd-279c0250fb69 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:26.223032 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88042f85-0df9-47c9-83bd-279c0250fb69 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:26.223951 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88042f85-0df9-47c9-83bd-279c0250fb69 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:26.224591 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88042f85-0df9-47c9-83bd-279c0250fb69 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:26.225706 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88042f85-0df9-47c9-83bd-279c0250fb69 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:26.226370 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88042f85-0df9-47c9-83bd-279c0250fb69 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:26.227114 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88042f85-0df9-47c9-83bd-279c0250fb69 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:26.330034 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-bea0f801-186c-4544-a029-afccffee7408 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:26.338245 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bea0f801-186c-4544-a029-afccffee7408 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1273 microversion: 2.1 time: 0.244731 Oct 17 04:31:26.341900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 17/27] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:26 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:26.357995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3e9411c0-b65f-4752-8b5e-9ae52bd6d5c8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:26.360671 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3e9411c0-b65f-4752-8b5e-9ae52bd6d5c8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:26.425581 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-88042f85-0df9-47c9-83bd-279c0250fb69 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:26.442449 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-88042f85-0df9-47c9-83bd-279c0250fb69 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:26.453019 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-88042f85-0df9-47c9-83bd-279c0250fb69 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:26.458469 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-88042f85-0df9-47c9-83bd-279c0250fb69 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1340 microversion: 2.20 time: 0.254362 Oct 17 04:31:26.460911 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 11/28] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:31:26 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1340 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:31:26.536535 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-3e9411c0-b65f-4752-8b5e-9ae52bd6d5c8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:26.550236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3e9411c0-b65f-4752-8b5e-9ae52bd6d5c8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1241 microversion: 2.1 time: 0.202277 Oct 17 04:31:26.553439 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 18/29] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:26 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1241 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:26.882855 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-72e1f923-6f82-4afd-a9af-7062273961a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:26.884144 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-72e1f923-6f82-4afd-a9af-7062273961a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:26.916474 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72e1f923-6f82-4afd-a9af-7062273961a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:26.929212 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72e1f923-6f82-4afd-a9af-7062273961a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:26.929972 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72e1f923-6f82-4afd-a9af-7062273961a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:26.931888 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72e1f923-6f82-4afd-a9af-7062273961a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:26.933791 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72e1f923-6f82-4afd-a9af-7062273961a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:26.935005 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-72e1f923-6f82-4afd-a9af-7062273961a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:27.128962 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2bb33342-2a2c-4240-8392-fbf55d7898a8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:27.131022 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2bb33342-2a2c-4240-8392-fbf55d7898a8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:27.161530 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2bb33342-2a2c-4240-8392-fbf55d7898a8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:27.164016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2bb33342-2a2c-4240-8392-fbf55d7898a8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:27.164655 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2bb33342-2a2c-4240-8392-fbf55d7898a8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:27.165747 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2bb33342-2a2c-4240-8392-fbf55d7898a8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:27.180634 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2bb33342-2a2c-4240-8392-fbf55d7898a8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:27.190038 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2bb33342-2a2c-4240-8392-fbf55d7898a8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:27.759103 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-72e1f923-6f82-4afd-a9af-7062273961a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:27.777163 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-72e1f923-6f82-4afd-a9af-7062273961a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1290 microversion: 2.1 time: 0.898284 Oct 17 04:31:27.832569 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 12/30] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:26 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1290 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:27.865460 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-52edc978-f538-49bd-82f8-5f08d9ffb0b2 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:27.874572 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-52edc978-f538-49bd-82f8-5f08d9ffb0b2 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:27.903482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52edc978-f538-49bd-82f8-5f08d9ffb0b2 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:27.904000 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52edc978-f538-49bd-82f8-5f08d9ffb0b2 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:27.904444 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52edc978-f538-49bd-82f8-5f08d9ffb0b2 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:27.905222 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52edc978-f538-49bd-82f8-5f08d9ffb0b2 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:27.922120 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52edc978-f538-49bd-82f8-5f08d9ffb0b2 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:27.922773 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-52edc978-f538-49bd-82f8-5f08d9ffb0b2 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:28.651678 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-2bb33342-2a2c-4240-8392-fbf55d7898a8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:28.675114 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2bb33342-2a2c-4240-8392-fbf55d7898a8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1322 microversion: 2.1 time: 1.557215 Oct 17 04:31:28.678518 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 19/31] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:27 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1322 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:28.717803 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a72ce29e-179d-42aa-91af-52c287aa9775 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:28.723080 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a72ce29e-179d-42aa-91af-52c287aa9775 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:28.787076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a72ce29e-179d-42aa-91af-52c287aa9775 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:28.800251 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a72ce29e-179d-42aa-91af-52c287aa9775 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:28.804174 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a72ce29e-179d-42aa-91af-52c287aa9775 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:28.813684 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a72ce29e-179d-42aa-91af-52c287aa9775 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:28.815885 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a72ce29e-179d-42aa-91af-52c287aa9775 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:28.820768 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a72ce29e-179d-42aa-91af-52c287aa9775 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:28.925682 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-52edc978-f538-49bd-82f8-5f08d9ffb0b2 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:28.950245 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-52edc978-f538-49bd-82f8-5f08d9ffb0b2 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1315 microversion: 2.1 time: 1.115900 Oct 17 04:31:28.950835 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 13/32] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:27 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1315 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:28.975575 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7bacead2-ddb4-43ba-b940-fcd168cd783b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:28.976245 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7bacead2-ddb4-43ba-b940-fcd168cd783b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:29.046219 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bacead2-ddb4-43ba-b940-fcd168cd783b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:29.046774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bacead2-ddb4-43ba-b940-fcd168cd783b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:29.047223 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bacead2-ddb4-43ba-b940-fcd168cd783b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:29.048007 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bacead2-ddb4-43ba-b940-fcd168cd783b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:29.048488 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bacead2-ddb4-43ba-b940-fcd168cd783b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:29.048938 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7bacead2-ddb4-43ba-b940-fcd168cd783b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:29.236479 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a72ce29e-179d-42aa-91af-52c287aa9775 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:29.258986 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a72ce29e-179d-42aa-91af-52c287aa9775 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:29.261271 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a72ce29e-179d-42aa-91af-52c287aa9775 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:29.262425 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a72ce29e-179d-42aa-91af-52c287aa9775 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1340 microversion: 2.20 time: 0.570615 Oct 17 04:31:29.262990 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 20/33] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:31:28 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1340 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:31:29.281174 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6bc7ecb8-e7f1-4ac8-9a08-21a47be8cd9b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:29.282052 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6bc7ecb8-e7f1-4ac8-9a08-21a47be8cd9b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:29.304291 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6bc7ecb8-e7f1-4ac8-9a08-21a47be8cd9b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:29.305041 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6bc7ecb8-e7f1-4ac8-9a08-21a47be8cd9b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:29.305663 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6bc7ecb8-e7f1-4ac8-9a08-21a47be8cd9b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:29.306718 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6bc7ecb8-e7f1-4ac8-9a08-21a47be8cd9b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:29.308877 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6bc7ecb8-e7f1-4ac8-9a08-21a47be8cd9b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:29.309494 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6bc7ecb8-e7f1-4ac8-9a08-21a47be8cd9b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:29.327292 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-7bacead2-ddb4-43ba-b940-fcd168cd783b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:29.344906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7bacead2-ddb4-43ba-b940-fcd168cd783b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1293 microversion: 2.1 time: 0.373336 Oct 17 04:31:29.345537 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 14/34] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:28 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1293 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:29.570841 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-6bc7ecb8-e7f1-4ac8-9a08-21a47be8cd9b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:29.614524 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6bc7ecb8-e7f1-4ac8-9a08-21a47be8cd9b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1296 microversion: 2.1 time: 0.343707 Oct 17 04:31:29.617697 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 21/35] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:29 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1296 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:29.702040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d6c5d35c-a886-48b4-933d-fa6a974277e6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:29.702656 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d6c5d35c-a886-48b4-933d-fa6a974277e6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:29.714392 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6c5d35c-a886-48b4-933d-fa6a974277e6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:29.714916 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6c5d35c-a886-48b4-933d-fa6a974277e6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:29.719064 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6c5d35c-a886-48b4-933d-fa6a974277e6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:29.721254 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6c5d35c-a886-48b4-933d-fa6a974277e6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:29.723641 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6c5d35c-a886-48b4-933d-fa6a974277e6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:29.724461 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6c5d35c-a886-48b4-933d-fa6a974277e6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:29.974029 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c86be5f3-0de0-475a-88b3-dbe24975fc4f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:29.974601 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c86be5f3-0de0-475a-88b3-dbe24975fc4f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:29.985105 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c86be5f3-0de0-475a-88b3-dbe24975fc4f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:29.986145 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c86be5f3-0de0-475a-88b3-dbe24975fc4f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:29.986749 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c86be5f3-0de0-475a-88b3-dbe24975fc4f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:29.988398 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c86be5f3-0de0-475a-88b3-dbe24975fc4f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:29.991157 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c86be5f3-0de0-475a-88b3-dbe24975fc4f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:29.991870 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c86be5f3-0de0-475a-88b3-dbe24975fc4f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:31.562008 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d6c5d35c-a886-48b4-933d-fa6a974277e6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:31.574684 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d6c5d35c-a886-48b4-933d-fa6a974277e6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1322 microversion: 2.1 time: 1.876577 Oct 17 04:31:31.575496 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 15/36] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:29 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1322 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:31.582947 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6fd7844a-84d4-4226-af5f-def477bd8381 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:31.595854 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6fd7844a-84d4-4226-af5f-def477bd8381 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:31.611311 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fd7844a-84d4-4226-af5f-def477bd8381 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:31.611878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fd7844a-84d4-4226-af5f-def477bd8381 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:31.612333 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fd7844a-84d4-4226-af5f-def477bd8381 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:31.613037 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fd7844a-84d4-4226-af5f-def477bd8381 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:31.613686 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fd7844a-84d4-4226-af5f-def477bd8381 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:31.618483 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fd7844a-84d4-4226-af5f-def477bd8381 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:32.352706 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c86be5f3-0de0-475a-88b3-dbe24975fc4f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:32.376445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c86be5f3-0de0-475a-88b3-dbe24975fc4f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1315 microversion: 2.1 time: 2.406247 Oct 17 04:31:32.382523 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 22/37] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:29 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1315 bytes in 2413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:31:32.435475 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1d01c4d3-8c10-45d2-ab9e-fef0d9d99b63 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:32.437846 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1d01c4d3-8c10-45d2-ab9e-fef0d9d99b63 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:32.464117 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d01c4d3-8c10-45d2-ab9e-fef0d9d99b63 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:32.464666 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d01c4d3-8c10-45d2-ab9e-fef0d9d99b63 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:32.469523 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d01c4d3-8c10-45d2-ab9e-fef0d9d99b63 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:32.470414 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d01c4d3-8c10-45d2-ab9e-fef0d9d99b63 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:32.470916 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d01c4d3-8c10-45d2-ab9e-fef0d9d99b63 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:32.471358 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d01c4d3-8c10-45d2-ab9e-fef0d9d99b63 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:32.521942 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:32.644466 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-1d01c4d3-8c10-45d2-ab9e-fef0d9d99b63 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:32.664580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1d01c4d3-8c10-45d2-ab9e-fef0d9d99b63 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1299 microversion: 2.1 time: 0.272030 Oct 17 04:31:32.668676 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 23/38] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:32 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1299 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:32.682820 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-02113a56-8d07-4f12-925f-3938983ff263 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:32.683800 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-02113a56-8d07-4f12-925f-3938983ff263 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:32.718149 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02113a56-8d07-4f12-925f-3938983ff263 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:32.718628 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02113a56-8d07-4f12-925f-3938983ff263 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:32.719205 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02113a56-8d07-4f12-925f-3938983ff263 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:32.725559 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02113a56-8d07-4f12-925f-3938983ff263 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:32.726546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02113a56-8d07-4f12-925f-3938983ff263 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:32.732682 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02113a56-8d07-4f12-925f-3938983ff263 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:32.782084 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:32.792061 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-6fd7844a-84d4-4226-af5f-def477bd8381 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:32.802273 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-6fd7844a-84d4-4226-af5f-def477bd8381 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:32.828287 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-6fd7844a-84d4-4226-af5f-def477bd8381 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:32.828767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6fd7844a-84d4-4226-af5f-def477bd8381 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1407 microversion: 2.20 time: 1.252034 Oct 17 04:31:32.834645 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 16/39] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:31:31 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1407 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:31:32.996300 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-2e2cda3e-5d09-46a1-aac4-3bf5bfc9081d req-9c472940-2e17-4bd5-9aef-609b4cce35f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d8b2344-7541-41fa-b97f-734e7220308c", "tag": "d527852d-57b4-4e00-893c-ff6f8df97d89"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:33.030336 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2e2cda3e-5d09-46a1-aac4-3bf5bfc9081d req-9c472940-2e17-4bd5-9aef-609b4cce35f3 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:33.035250 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2e2cda3e-5d09-46a1-aac4-3bf5bfc9081d req-9c472940-2e17-4bd5-9aef-609b4cce35f3 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:33.035964 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2e2cda3e-5d09-46a1-aac4-3bf5bfc9081d req-9c472940-2e17-4bd5-9aef-609b4cce35f3 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:33.069564 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-02113a56-8d07-4f12-925f-3938983ff263 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:33.079585 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-02113a56-8d07-4f12-925f-3938983ff263 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1296 microversion: 2.1 time: 0.409541 Oct 17 04:31:33.093548 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 24/40] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:32 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1296 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:33.114999 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8839073d-de2a-4735-814c-dbfb68d58a45 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:33.115814 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8839073d-de2a-4735-814c-dbfb68d58a45 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:33.118481 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-2e2cda3e-5d09-46a1-aac4-3bf5bfc9081d req-9c472940-2e17-4bd5-9aef-609b4cce35f3 service nova] Creating event network-changed:d527852d-57b4-4e00-893c-ff6f8df97d89 for instance 9d8b2344-7541-41fa-b97f-734e7220308c on hv-cinder-86155 Oct 17 04:31:33.124616 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2e2cda3e-5d09-46a1-aac4-3bf5bfc9081d req-9c472940-2e17-4bd5-9aef-609b4cce35f3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 04:31:33.124616 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-2e2cda3e-5d09-46a1-aac4-3bf5bfc9081d req-9c472940-2e17-4bd5-9aef-609b4cce35f3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 04:31:33.124616 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5569c827-2082-46de-b966-1195fd7bca85 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:33.127049 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5569c827-2082-46de-b966-1195fd7bca85 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:33.127599 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5569c827-2082-46de-b966-1195fd7bca85 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:33.128520 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5569c827-2082-46de-b966-1195fd7bca85 None None] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:33.128993 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5569c827-2082-46de-b966-1195fd7bca85 None None] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:33.129547 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5569c827-2082-46de-b966-1195fd7bca85 None None] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:33.138538 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8839073d-de2a-4735-814c-dbfb68d58a45 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:33.139635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8839073d-de2a-4735-814c-dbfb68d58a45 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:33.140423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8839073d-de2a-4735-814c-dbfb68d58a45 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:33.141472 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8839073d-de2a-4735-814c-dbfb68d58a45 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:33.142170 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8839073d-de2a-4735-814c-dbfb68d58a45 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:33.143040 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8839073d-de2a-4735-814c-dbfb68d58a45 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:33.145659 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.compute.rpcapi [None req-5569c827-2082-46de-b966-1195fd7bca85 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 04:31:33.146896 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5569c827-2082-46de-b966-1195fd7bca85 None None] Releasing lock "compute-rpcapi-router" {{(pid=119128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 04:31:33.196822 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5569c827-2082-46de-b966-1195fd7bca85 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.360075 Oct 17 04:31:33.198062 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 17/41] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:31:33.412038 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d5fc1d03-6aac-4946-b6aa-e0830e8b96a6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:33.412944 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d5fc1d03-6aac-4946-b6aa-e0830e8b96a6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:33.427436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:33.434212 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5fc1d03-6aac-4946-b6aa-e0830e8b96a6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:33.435929 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5fc1d03-6aac-4946-b6aa-e0830e8b96a6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:33.438755 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5fc1d03-6aac-4946-b6aa-e0830e8b96a6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:33.441144 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5fc1d03-6aac-4946-b6aa-e0830e8b96a6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:33.443732 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5fc1d03-6aac-4946-b6aa-e0830e8b96a6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:33.466423 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5fc1d03-6aac-4946-b6aa-e0830e8b96a6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:34.250603 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-8839073d-de2a-4735-814c-dbfb68d58a45 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:34.262729 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8839073d-de2a-4735-814c-dbfb68d58a45 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1322 microversion: 2.1 time: 1.151912 Oct 17 04:31:34.263329 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 25/42] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:33 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1322 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:34.289166 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2d37cf18-1006-4174-a6d1-cf3157b23900 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:34.289782 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2d37cf18-1006-4174-a6d1-cf3157b23900 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:34.317226 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d37cf18-1006-4174-a6d1-cf3157b23900 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:34.317971 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d37cf18-1006-4174-a6d1-cf3157b23900 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:34.318557 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d37cf18-1006-4174-a6d1-cf3157b23900 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:34.319446 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d37cf18-1006-4174-a6d1-cf3157b23900 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:34.320052 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d37cf18-1006-4174-a6d1-cf3157b23900 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:34.321913 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d37cf18-1006-4174-a6d1-cf3157b23900 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:34.808396 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-2d37cf18-1006-4174-a6d1-cf3157b23900 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:34.829717 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2d37cf18-1006-4174-a6d1-cf3157b23900 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1299 microversion: 2.1 time: 0.545948 Oct 17 04:31:34.832691 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 26/43] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:34 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1299 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:34.876930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d5fc1d03-6aac-4946-b6aa-e0830e8b96a6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:34.881205 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-78092e79-4f81-4251-be46-f514710934d5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:34.881923 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-78092e79-4f81-4251-be46-f514710934d5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:34.899631 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d5fc1d03-6aac-4946-b6aa-e0830e8b96a6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1315 microversion: 2.1 time: 1.490622 Oct 17 04:31:34.905457 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78092e79-4f81-4251-be46-f514710934d5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:34.906583 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78092e79-4f81-4251-be46-f514710934d5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:34.907722 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78092e79-4f81-4251-be46-f514710934d5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:34.909619 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78092e79-4f81-4251-be46-f514710934d5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:34.910782 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78092e79-4f81-4251-be46-f514710934d5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:34.914190 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78092e79-4f81-4251-be46-f514710934d5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:34.917927 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 18/44] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:33 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1315 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:34.926169 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e921f1a4-51fc-4dc5-8754-f07a7ad049d3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:34.927025 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e921f1a4-51fc-4dc5-8754-f07a7ad049d3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:34.936831 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e921f1a4-51fc-4dc5-8754-f07a7ad049d3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:34.937961 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e921f1a4-51fc-4dc5-8754-f07a7ad049d3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:34.938585 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e921f1a4-51fc-4dc5-8754-f07a7ad049d3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:34.939484 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e921f1a4-51fc-4dc5-8754-f07a7ad049d3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:34.948805 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e921f1a4-51fc-4dc5-8754-f07a7ad049d3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:34.950185 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e921f1a4-51fc-4dc5-8754-f07a7ad049d3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:35.515536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-78092e79-4f81-4251-be46-f514710934d5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:35.548675 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-78092e79-4f81-4251-be46-f514710934d5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:35.558842 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-78092e79-4f81-4251-be46-f514710934d5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:35.564657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-78092e79-4f81-4251-be46-f514710934d5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1407 microversion: 2.20 time: 0.727135 Oct 17 04:31:35.568166 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 27/45] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:31:34 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1407 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:31:35.978204 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-9a00c421-35d6-4d9c-8836-ef74996c6232 req-7c29f916-058e-4550-b1a4-9586cdf5ac68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75c34166-9c02-41cb-b5e6-21cc7c4b06b7", "tag": "62afe409-bc34-457e-bcb8-6b6ebb859ed6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:36.004861 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9a00c421-35d6-4d9c-8836-ef74996c6232 req-7c29f916-058e-4550-b1a4-9586cdf5ac68 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:36.005562 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9a00c421-35d6-4d9c-8836-ef74996c6232 req-7c29f916-058e-4550-b1a4-9586cdf5ac68 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:36.006161 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9a00c421-35d6-4d9c-8836-ef74996c6232 req-7c29f916-058e-4550-b1a4-9586cdf5ac68 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:36.035347 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-9a00c421-35d6-4d9c-8836-ef74996c6232 req-7c29f916-058e-4550-b1a4-9586cdf5ac68 service nova] Creating event network-changed:62afe409-bc34-457e-bcb8-6b6ebb859ed6 for instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 on hv-cinder-86155 Oct 17 04:31:36.036755 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9a00c421-35d6-4d9c-8836-ef74996c6232 req-7c29f916-058e-4550-b1a4-9586cdf5ac68 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 04:31:36.037405 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-9a00c421-35d6-4d9c-8836-ef74996c6232 req-7c29f916-058e-4550-b1a4-9586cdf5ac68 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 04:31:36.039640 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df39c5bf-7cdd-43ed-a14e-1b7e689056f6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:36.040283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df39c5bf-7cdd-43ed-a14e-1b7e689056f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:36.040721 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df39c5bf-7cdd-43ed-a14e-1b7e689056f6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:36.042209 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df39c5bf-7cdd-43ed-a14e-1b7e689056f6 None None] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:36.042681 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df39c5bf-7cdd-43ed-a14e-1b7e689056f6 None None] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:36.043287 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df39c5bf-7cdd-43ed-a14e-1b7e689056f6 None None] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:36.055079 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.compute.rpcapi [None req-df39c5bf-7cdd-43ed-a14e-1b7e689056f6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 04:31:36.055990 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df39c5bf-7cdd-43ed-a14e-1b7e689056f6 None None] Releasing lock "compute-rpcapi-router" {{(pid=119127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 04:31:36.074097 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-df39c5bf-7cdd-43ed-a14e-1b7e689056f6 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.496974 Oct 17 04:31:36.074707 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 28/46] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:31:36.076312 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=30 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:36.080696 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f8c15fb1-4f53-4336-9d2e-8a26833d5b2f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:36.081495 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f8c15fb1-4f53-4336-9d2e-8a26833d5b2f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:36.086863 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e921f1a4-51fc-4dc5-8754-f07a7ad049d3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:36.088413 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8c15fb1-4f53-4336-9d2e-8a26833d5b2f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:36.089273 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8c15fb1-4f53-4336-9d2e-8a26833d5b2f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:36.090025 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8c15fb1-4f53-4336-9d2e-8a26833d5b2f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:36.091190 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8c15fb1-4f53-4336-9d2e-8a26833d5b2f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:36.091895 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8c15fb1-4f53-4336-9d2e-8a26833d5b2f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:36.092592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8c15fb1-4f53-4336-9d2e-8a26833d5b2f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:36.094971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e921f1a4-51fc-4dc5-8754-f07a7ad049d3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1363 microversion: 2.1 time: 1.175662 Oct 17 04:31:36.111492 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 19/47] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:34 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1363 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:36.116819 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d603b4dc-8982-4467-a815-112045ff0161 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:36.117796 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d603b4dc-8982-4467-a815-112045ff0161 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:36.124826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d603b4dc-8982-4467-a815-112045ff0161 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:36.126456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d603b4dc-8982-4467-a815-112045ff0161 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:36.127095 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d603b4dc-8982-4467-a815-112045ff0161 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:36.128004 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d603b4dc-8982-4467-a815-112045ff0161 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:36.133308 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d603b4dc-8982-4467-a815-112045ff0161 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:36.134185 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d603b4dc-8982-4467-a815-112045ff0161 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:36.267425 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d603b4dc-8982-4467-a815-112045ff0161 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:36.276587 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d603b4dc-8982-4467-a815-112045ff0161 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1299 microversion: 2.1 time: 0.163087 Oct 17 04:31:36.277440 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 20/48] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:36 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1299 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:36.294170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4ff1b909-bd2c-4b2b-a24c-6ec30ed4d64b tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:36.295055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4ff1b909-bd2c-4b2b-a24c-6ec30ed4d64b tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:36.303100 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ff1b909-bd2c-4b2b-a24c-6ec30ed4d64b tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:36.303783 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ff1b909-bd2c-4b2b-a24c-6ec30ed4d64b tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:36.304560 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ff1b909-bd2c-4b2b-a24c-6ec30ed4d64b tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:36.305580 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ff1b909-bd2c-4b2b-a24c-6ec30ed4d64b tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:36.305893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ff1b909-bd2c-4b2b-a24c-6ec30ed4d64b tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:36.306466 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ff1b909-bd2c-4b2b-a24c-6ec30ed4d64b tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:36.498756 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f8c15fb1-4f53-4336-9d2e-8a26833d5b2f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:36.508904 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f8c15fb1-4f53-4336-9d2e-8a26833d5b2f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1322 microversion: 2.1 time: 0.432831 Oct 17 04:31:36.509525 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 29/49] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:36 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:36.593024 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a50e258-e189-461b-b0ff-8592bdaf76e9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:36.593783 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1a50e258-e189-461b-b0ff-8592bdaf76e9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:36.595978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=30 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:36.604296 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a50e258-e189-461b-b0ff-8592bdaf76e9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:36.604829 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a50e258-e189-461b-b0ff-8592bdaf76e9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:36.605613 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a50e258-e189-461b-b0ff-8592bdaf76e9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:36.606809 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a50e258-e189-461b-b0ff-8592bdaf76e9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:36.607421 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a50e258-e189-461b-b0ff-8592bdaf76e9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:36.608094 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a50e258-e189-461b-b0ff-8592bdaf76e9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:36.952167 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-4ff1b909-bd2c-4b2b-a24c-6ec30ed4d64b tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:36.961955 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4ff1b909-bd2c-4b2b-a24c-6ec30ed4d64b tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1315 microversion: 2.1 time: 0.683132 Oct 17 04:31:36.962975 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 21/50] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:36 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:37.029624 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a50e258-e189-461b-b0ff-8592bdaf76e9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:37.038783 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a50e258-e189-461b-b0ff-8592bdaf76e9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:37.040748 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a50e258-e189-461b-b0ff-8592bdaf76e9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:37.043197 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1a50e258-e189-461b-b0ff-8592bdaf76e9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1407 microversion: 2.20 time: 0.454012 Oct 17 04:31:37.053926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 30/51] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:31:36 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:31:37.120180 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bc18bf32-974d-441f-8ca5-f10902ee1d0f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:37.121619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bc18bf32-974d-441f-8ca5-f10902ee1d0f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:37.132861 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bc18bf32-974d-441f-8ca5-f10902ee1d0f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:37.133654 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bc18bf32-974d-441f-8ca5-f10902ee1d0f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:37.135119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bc18bf32-974d-441f-8ca5-f10902ee1d0f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:37.136390 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bc18bf32-974d-441f-8ca5-f10902ee1d0f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:37.138483 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bc18bf32-974d-441f-8ca5-f10902ee1d0f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:37.139234 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bc18bf32-974d-441f-8ca5-f10902ee1d0f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:37.303248 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2d286f05-8e2d-4eed-8f71-7fda56a6143c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:37.304678 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2d286f05-8e2d-4eed-8f71-7fda56a6143c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:37.330049 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d286f05-8e2d-4eed-8f71-7fda56a6143c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:37.332198 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d286f05-8e2d-4eed-8f71-7fda56a6143c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:37.332885 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d286f05-8e2d-4eed-8f71-7fda56a6143c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:37.334096 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d286f05-8e2d-4eed-8f71-7fda56a6143c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:37.334649 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d286f05-8e2d-4eed-8f71-7fda56a6143c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:37.335366 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2d286f05-8e2d-4eed-8f71-7fda56a6143c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:37.349321 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-bc18bf32-974d-441f-8ca5-f10902ee1d0f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:37.358213 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bc18bf32-974d-441f-8ca5-f10902ee1d0f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1363 microversion: 2.1 time: 0.243061 Oct 17 04:31:37.360896 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 22/52] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:37 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:37.494168 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-2d286f05-8e2d-4eed-8f71-7fda56a6143c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:37.503142 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2d286f05-8e2d-4eed-8f71-7fda56a6143c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1366 microversion: 2.1 time: 0.204989 Oct 17 04:31:37.533136 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4102b1ad-4257-41a2-9790-112cd4603ff3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:37.533834 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 31/53] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:37 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:31:37.534529 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4102b1ad-4257-41a2-9790-112cd4603ff3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:37.542402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4102b1ad-4257-41a2-9790-112cd4603ff3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:37.543218 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4102b1ad-4257-41a2-9790-112cd4603ff3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:37.543888 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4102b1ad-4257-41a2-9790-112cd4603ff3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:37.545253 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4102b1ad-4257-41a2-9790-112cd4603ff3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:37.545808 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4102b1ad-4257-41a2-9790-112cd4603ff3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:37.546289 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4102b1ad-4257-41a2-9790-112cd4603ff3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:37.981178 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-4102b1ad-4257-41a2-9790-112cd4603ff3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:37.993108 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-70b41d6a-2814-4440-89f9-238f4f942a0f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:37.993956 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-70b41d6a-2814-4440-89f9-238f4f942a0f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:37.995286 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4102b1ad-4257-41a2-9790-112cd4603ff3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1322 microversion: 2.1 time: 0.464803 Oct 17 04:31:37.999885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 23/54] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:37 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:31:38.004428 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70b41d6a-2814-4440-89f9-238f4f942a0f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:38.006310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70b41d6a-2814-4440-89f9-238f4f942a0f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:38.006750 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70b41d6a-2814-4440-89f9-238f4f942a0f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:38.007531 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70b41d6a-2814-4440-89f9-238f4f942a0f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:38.008006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70b41d6a-2814-4440-89f9-238f4f942a0f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:38.008455 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-70b41d6a-2814-4440-89f9-238f4f942a0f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:38.071934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-030e7b6c-9238-42d1-9f57-0be6cda7f194 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:38.072620 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-030e7b6c-9238-42d1-9f57-0be6cda7f194 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:38.083865 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-030e7b6c-9238-42d1-9f57-0be6cda7f194 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:38.084427 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-030e7b6c-9238-42d1-9f57-0be6cda7f194 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:38.087283 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-030e7b6c-9238-42d1-9f57-0be6cda7f194 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:38.094891 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-030e7b6c-9238-42d1-9f57-0be6cda7f194 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:38.095724 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-030e7b6c-9238-42d1-9f57-0be6cda7f194 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:38.096585 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-030e7b6c-9238-42d1-9f57-0be6cda7f194 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:38.530838 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-70b41d6a-2814-4440-89f9-238f4f942a0f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:38.540199 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-70b41d6a-2814-4440-89f9-238f4f942a0f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1315 microversion: 2.1 time: 0.557124 Oct 17 04:31:38.540574 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 32/55] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:37 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:38.560941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-eea221b2-87dd-4375-adcc-88e57d5534e1 req-cdbe75df-6fc2-4473-bbae-470167586d6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "942796c5-f5b3-476a-ae21-dcaabf3bd8df", "tag": "37d6f19d-2ed4-4803-ac7c-8e9517972bc6"}, {"name": "network-changed", "server_uuid": "ee04d43c-6d11-4571-989e-90ee8175e03d", "tag": "f63f40c8-b445-4c27-a582-2ac29415fbeb"}, {"name": "network-changed", "server_uuid": "bf59bfb1-79b1-4ebe-9635-380231dec617", "tag": "1b48d51f-4326-473b-8c9d-416ea81fac1e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:38.616704 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-eea221b2-87dd-4375-adcc-88e57d5534e1 req-cdbe75df-6fc2-4473-bbae-470167586d6f service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:38.617253 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-eea221b2-87dd-4375-adcc-88e57d5534e1 req-cdbe75df-6fc2-4473-bbae-470167586d6f service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:38.617692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-eea221b2-87dd-4375-adcc-88e57d5534e1 req-cdbe75df-6fc2-4473-bbae-470167586d6f service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:38.644930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-eea221b2-87dd-4375-adcc-88e57d5534e1 req-cdbe75df-6fc2-4473-bbae-470167586d6f service nova] Creating event network-changed:37d6f19d-2ed4-4803-ac7c-8e9517972bc6 for instance 942796c5-f5b3-476a-ae21-dcaabf3bd8df on hv-cinder-86155 Oct 17 04:31:38.645474 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-eea221b2-87dd-4375-adcc-88e57d5534e1 req-cdbe75df-6fc2-4473-bbae-470167586d6f service nova] Creating event network-changed:f63f40c8-b445-4c27-a582-2ac29415fbeb for instance ee04d43c-6d11-4571-989e-90ee8175e03d on hv-cinder-86155 Oct 17 04:31:38.657461 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-030e7b6c-9238-42d1-9f57-0be6cda7f194 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:38.661542 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:38.664849 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-eea221b2-87dd-4375-adcc-88e57d5534e1 req-cdbe75df-6fc2-4473-bbae-470167586d6f service nova] Creating event network-changed:1b48d51f-4326-473b-8c9d-416ea81fac1e for instance bf59bfb1-79b1-4ebe-9635-380231dec617 on hv-cinder-86155 Oct 17 04:31:38.668277 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-030e7b6c-9238-42d1-9f57-0be6cda7f194 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:38.674961 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-030e7b6c-9238-42d1-9f57-0be6cda7f194 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:38.676368 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-030e7b6c-9238-42d1-9f57-0be6cda7f194 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1407 microversion: 2.20 time: 0.608509 Oct 17 04:31:38.678936 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 24/56] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:31:38 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1407 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:31:38.684412 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-394b4200-a9b2-4b34-8b58-42339aaade05 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:38.686403 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-eea221b2-87dd-4375-adcc-88e57d5534e1 req-cdbe75df-6fc2-4473-bbae-470167586d6f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.144588 Oct 17 04:31:38.687013 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 33/57] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:31:38.693655 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-394b4200-a9b2-4b34-8b58-42339aaade05 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:38.700039 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3629de75-9e8e-4046-ab99-1f519e8e4da7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:38.710750 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3629de75-9e8e-4046-ab99-1f519e8e4da7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:38.717537 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-394b4200-a9b2-4b34-8b58-42339aaade05 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:38.718030 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-394b4200-a9b2-4b34-8b58-42339aaade05 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:38.724850 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3629de75-9e8e-4046-ab99-1f519e8e4da7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:38.725367 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3629de75-9e8e-4046-ab99-1f519e8e4da7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:38.725806 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3629de75-9e8e-4046-ab99-1f519e8e4da7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:38.726545 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3629de75-9e8e-4046-ab99-1f519e8e4da7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:38.726968 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3629de75-9e8e-4046-ab99-1f519e8e4da7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:38.727395 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3629de75-9e8e-4046-ab99-1f519e8e4da7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:38.729968 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-394b4200-a9b2-4b34-8b58-42339aaade05 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:38.730722 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-394b4200-a9b2-4b34-8b58-42339aaade05 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:38.731193 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-394b4200-a9b2-4b34-8b58-42339aaade05 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:38.731619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-394b4200-a9b2-4b34-8b58-42339aaade05 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:39.241287 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-3629de75-9e8e-4046-ab99-1f519e8e4da7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:39.254259 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3629de75-9e8e-4046-ab99-1f519e8e4da7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1366 microversion: 2.1 time: 0.562499 Oct 17 04:31:39.256375 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 34/58] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:38 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1366 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:39.280182 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc2d3348-b236-4792-b675-d97708042201 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:39.282054 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bc2d3348-b236-4792-b675-d97708042201 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:39.299707 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc2d3348-b236-4792-b675-d97708042201 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:39.311129 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc2d3348-b236-4792-b675-d97708042201 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:39.311721 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc2d3348-b236-4792-b675-d97708042201 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:39.315595 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc2d3348-b236-4792-b675-d97708042201 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:39.316570 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc2d3348-b236-4792-b675-d97708042201 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:39.318768 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc2d3348-b236-4792-b675-d97708042201 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:39.676759 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-394b4200-a9b2-4b34-8b58-42339aaade05 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:39.685323 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-394b4200-a9b2-4b34-8b58-42339aaade05 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1363 microversion: 2.1 time: 1.005124 Oct 17 04:31:39.689411 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 25/59] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:38 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1363 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:39.694530 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ce89099c-2b82-4d97-814d-47de74ac8c3e tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:39.695154 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ce89099c-2b82-4d97-814d-47de74ac8c3e tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:39.717215 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce89099c-2b82-4d97-814d-47de74ac8c3e tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:39.717741 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce89099c-2b82-4d97-814d-47de74ac8c3e tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:39.718188 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce89099c-2b82-4d97-814d-47de74ac8c3e tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:39.718907 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce89099c-2b82-4d97-814d-47de74ac8c3e tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:39.719370 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce89099c-2b82-4d97-814d-47de74ac8c3e tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:39.719796 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce89099c-2b82-4d97-814d-47de74ac8c3e tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:39.919324 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-bc2d3348-b236-4792-b675-d97708042201 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:39.937825 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bc2d3348-b236-4792-b675-d97708042201 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1322 microversion: 2.1 time: 0.679377 Oct 17 04:31:39.938414 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 35/60] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:39 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1322 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:39.943429 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-56342c42-94b2-49fc-a5a9-6fcdf7e70101 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:39.944039 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-56342c42-94b2-49fc-a5a9-6fcdf7e70101 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:39.953310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56342c42-94b2-49fc-a5a9-6fcdf7e70101 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:39.956474 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56342c42-94b2-49fc-a5a9-6fcdf7e70101 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:39.956926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56342c42-94b2-49fc-a5a9-6fcdf7e70101 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:39.957689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56342c42-94b2-49fc-a5a9-6fcdf7e70101 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:39.958152 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56342c42-94b2-49fc-a5a9-6fcdf7e70101 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:39.958576 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56342c42-94b2-49fc-a5a9-6fcdf7e70101 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:40.095388 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-ce89099c-2b82-4d97-814d-47de74ac8c3e tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:40.111410 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ce89099c-2b82-4d97-814d-47de74ac8c3e tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1315 microversion: 2.1 time: 0.420832 Oct 17 04:31:40.112406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 26/61] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:39 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:40.231271 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-56342c42-94b2-49fc-a5a9-6fcdf7e70101 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:40.252034 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-56342c42-94b2-49fc-a5a9-6fcdf7e70101 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:40.265850 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-56342c42-94b2-49fc-a5a9-6fcdf7e70101 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:40.267012 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-56342c42-94b2-49fc-a5a9-6fcdf7e70101 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1407 microversion: 2.20 time: 0.327514 Oct 17 04:31:40.274646 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 36/62] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:31:39 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:31:40.282039 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-7dc4dbf0-7f7f-4c30-9d61-fb622a3b0ef1 req-3e5c0cee-27be-40e9-a9f8-056a6fec03f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc759c8-a208-4df1-bf3e-dd2b89bff369", "tag": "96c8acae-b8cc-4eed-af97-bcefcfe399c5"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:40.296985 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-63c86e54-b785-4e40-ad3c-7f7bd78df798 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:40.301636 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-63c86e54-b785-4e40-ad3c-7f7bd78df798 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:40.305214 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7dc4dbf0-7f7f-4c30-9d61-fb622a3b0ef1 req-3e5c0cee-27be-40e9-a9f8-056a6fec03f2 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:40.307527 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7dc4dbf0-7f7f-4c30-9d61-fb622a3b0ef1 req-3e5c0cee-27be-40e9-a9f8-056a6fec03f2 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:40.308308 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7dc4dbf0-7f7f-4c30-9d61-fb622a3b0ef1 req-3e5c0cee-27be-40e9-a9f8-056a6fec03f2 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:40.312286 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63c86e54-b785-4e40-ad3c-7f7bd78df798 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:40.312960 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63c86e54-b785-4e40-ad3c-7f7bd78df798 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:40.313542 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63c86e54-b785-4e40-ad3c-7f7bd78df798 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:40.314245 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63c86e54-b785-4e40-ad3c-7f7bd78df798 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:40.314695 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63c86e54-b785-4e40-ad3c-7f7bd78df798 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:40.315114 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63c86e54-b785-4e40-ad3c-7f7bd78df798 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:40.350920 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-7dc4dbf0-7f7f-4c30-9d61-fb622a3b0ef1 req-3e5c0cee-27be-40e9-a9f8-056a6fec03f2 service nova] Creating event network-changed:96c8acae-b8cc-4eed-af97-bcefcfe399c5 for instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 on hv-cinder-86155 Oct 17 04:31:40.364868 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-7dc4dbf0-7f7f-4c30-9d61-fb622a3b0ef1 req-3e5c0cee-27be-40e9-a9f8-056a6fec03f2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088797 Oct 17 04:31:40.373525 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 27/63] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:31:40.657108 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-5817fd1f-4122-447c-bc9c-1fa596dfda63 req-ac07047a-6876-44cb-ab0b-fb772595667d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d8b2344-7541-41fa-b97f-734e7220308c", "name": "network-vif-plugged", "status": "completed", "tag": "d527852d-57b4-4e00-893c-ff6f8df97d89"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:40.675186 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5817fd1f-4122-447c-bc9c-1fa596dfda63 req-ac07047a-6876-44cb-ab0b-fb772595667d service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:40.677695 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5817fd1f-4122-447c-bc9c-1fa596dfda63 req-ac07047a-6876-44cb-ab0b-fb772595667d service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:40.679289 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5817fd1f-4122-447c-bc9c-1fa596dfda63 req-ac07047a-6876-44cb-ab0b-fb772595667d service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:40.705591 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-5817fd1f-4122-447c-bc9c-1fa596dfda63 req-ac07047a-6876-44cb-ab0b-fb772595667d service nova] Creating event network-vif-plugged:d527852d-57b4-4e00-893c-ff6f8df97d89 for instance 9d8b2344-7541-41fa-b97f-734e7220308c on hv-cinder-86155 Oct 17 04:31:40.719744 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-5817fd1f-4122-447c-bc9c-1fa596dfda63 req-ac07047a-6876-44cb-ab0b-fb772595667d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166381 Oct 17 04:31:40.723487 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 28/64] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:31:40.729765 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7f12e909-6473-4512-940e-3fb83e9a2cf5 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:40.745458 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7f12e909-6473-4512-940e-3fb83e9a2cf5 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:40.764021 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f12e909-6473-4512-940e-3fb83e9a2cf5 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:40.767186 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f12e909-6473-4512-940e-3fb83e9a2cf5 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:40.768495 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f12e909-6473-4512-940e-3fb83e9a2cf5 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:40.770287 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f12e909-6473-4512-940e-3fb83e9a2cf5 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:40.772438 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f12e909-6473-4512-940e-3fb83e9a2cf5 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:40.775000 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f12e909-6473-4512-940e-3fb83e9a2cf5 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:41.108259 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-63c86e54-b785-4e40-ad3c-7f7bd78df798 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:41.145445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-63c86e54-b785-4e40-ad3c-7f7bd78df798 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1366 microversion: 2.1 time: 0.849052 Oct 17 04:31:41.146378 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 37/65] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:40 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1366 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:31:41.153797 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebce2c64-9496-4437-9eb7-058764ecc0af tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:41.154608 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ebce2c64-9496-4437-9eb7-058764ecc0af tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:41.161333 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebce2c64-9496-4437-9eb7-058764ecc0af tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:41.162036 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebce2c64-9496-4437-9eb7-058764ecc0af tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:41.163031 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebce2c64-9496-4437-9eb7-058764ecc0af tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:41.163882 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebce2c64-9496-4437-9eb7-058764ecc0af tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:41.165098 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebce2c64-9496-4437-9eb7-058764ecc0af tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:41.165695 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebce2c64-9496-4437-9eb7-058764ecc0af tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:41.200876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-7f12e909-6473-4512-940e-3fb83e9a2cf5 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:41.212204 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7f12e909-6473-4512-940e-3fb83e9a2cf5 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1363 microversion: 2.1 time: 0.487170 Oct 17 04:31:41.213768 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 29/66] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:40 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1363 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:41.219861 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6af66617-4c8f-41b5-8961-393e79b9e2d4 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:41.221471 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6af66617-4c8f-41b5-8961-393e79b9e2d4 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:41.242873 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6af66617-4c8f-41b5-8961-393e79b9e2d4 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:41.243405 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6af66617-4c8f-41b5-8961-393e79b9e2d4 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:41.243848 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6af66617-4c8f-41b5-8961-393e79b9e2d4 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:41.244630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6af66617-4c8f-41b5-8961-393e79b9e2d4 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:41.245122 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6af66617-4c8f-41b5-8961-393e79b9e2d4 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:41.245731 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6af66617-4c8f-41b5-8961-393e79b9e2d4 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:41.435388 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-ebce2c64-9496-4437-9eb7-058764ecc0af tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:41.446270 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ebce2c64-9496-4437-9eb7-058764ecc0af tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1322 microversion: 2.1 time: 0.298368 Oct 17 04:31:41.462371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 38/67] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:41 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:41.469879 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e46e75bd-2820-4cf1-916e-4f5002152e5c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:41.470966 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e46e75bd-2820-4cf1-916e-4f5002152e5c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:41.478522 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-6af66617-4c8f-41b5-8961-393e79b9e2d4 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:41.488484 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6af66617-4c8f-41b5-8961-393e79b9e2d4 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1315 microversion: 2.1 time: 0.273498 Oct 17 04:31:41.491276 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 30/68] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:41 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:41.491479 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e46e75bd-2820-4cf1-916e-4f5002152e5c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:41.492358 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e46e75bd-2820-4cf1-916e-4f5002152e5c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:41.492938 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e46e75bd-2820-4cf1-916e-4f5002152e5c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:41.493864 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e46e75bd-2820-4cf1-916e-4f5002152e5c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:41.495006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e46e75bd-2820-4cf1-916e-4f5002152e5c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:41.495443 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e46e75bd-2820-4cf1-916e-4f5002152e5c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:41.855576 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e46e75bd-2820-4cf1-916e-4f5002152e5c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:41.867852 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e46e75bd-2820-4cf1-916e-4f5002152e5c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:41.870135 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e46e75bd-2820-4cf1-916e-4f5002152e5c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:41.871997 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e46e75bd-2820-4cf1-916e-4f5002152e5c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1407 microversion: 2.20 time: 0.407722 Oct 17 04:31:41.873391 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 39/69] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:31:41 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1407 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:31:42.175394 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-15d89f05-51a0-46d6-ab44-a9d9ec94df84 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:42.176697 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-15d89f05-51a0-46d6-ab44-a9d9ec94df84 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:42.186363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15d89f05-51a0-46d6-ab44-a9d9ec94df84 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:42.189200 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15d89f05-51a0-46d6-ab44-a9d9ec94df84 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:42.192462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15d89f05-51a0-46d6-ab44-a9d9ec94df84 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:42.193265 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15d89f05-51a0-46d6-ab44-a9d9ec94df84 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:42.193744 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15d89f05-51a0-46d6-ab44-a9d9ec94df84 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:42.196370 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-15d89f05-51a0-46d6-ab44-a9d9ec94df84 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:42.234921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5d526724-655b-419e-b17b-79ad6321e2a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:42.235534 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5d526724-655b-419e-b17b-79ad6321e2a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:42.242665 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d526724-655b-419e-b17b-79ad6321e2a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:42.249783 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d526724-655b-419e-b17b-79ad6321e2a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:42.250546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d526724-655b-419e-b17b-79ad6321e2a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:42.251178 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d526724-655b-419e-b17b-79ad6321e2a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:42.251639 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d526724-655b-419e-b17b-79ad6321e2a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:42.252066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d526724-655b-419e-b17b-79ad6321e2a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:42.753306 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-15d89f05-51a0-46d6-ab44-a9d9ec94df84 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:42.761957 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-15d89f05-51a0-46d6-ab44-a9d9ec94df84 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1366 microversion: 2.1 time: 0.591736 Oct 17 04:31:42.775713 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 31/70] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:42 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1366 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:42.792076 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b3b62d0b-1cb0-40b5-8a62-0ced084bd705 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:42.793169 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b3b62d0b-1cb0-40b5-8a62-0ced084bd705 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:42.801654 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3b62d0b-1cb0-40b5-8a62-0ced084bd705 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:42.802618 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3b62d0b-1cb0-40b5-8a62-0ced084bd705 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:42.803240 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3b62d0b-1cb0-40b5-8a62-0ced084bd705 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:42.804302 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3b62d0b-1cb0-40b5-8a62-0ced084bd705 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:42.806094 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3b62d0b-1cb0-40b5-8a62-0ced084bd705 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:42.807319 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b3b62d0b-1cb0-40b5-8a62-0ced084bd705 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:43.016761 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5d526724-655b-419e-b17b-79ad6321e2a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:43.032327 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5d526724-655b-419e-b17b-79ad6321e2a6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1363 microversion: 2.1 time: 0.801223 Oct 17 04:31:43.034503 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 40/71] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:42 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1363 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:43.040998 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b0e91624-e4c6-4a0e-ad0a-45b92a21d711 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:43.042991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b0e91624-e4c6-4a0e-ad0a-45b92a21d711 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:43.051619 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0e91624-e4c6-4a0e-ad0a-45b92a21d711 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:43.052427 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0e91624-e4c6-4a0e-ad0a-45b92a21d711 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:43.053197 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0e91624-e4c6-4a0e-ad0a-45b92a21d711 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:43.055386 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0e91624-e4c6-4a0e-ad0a-45b92a21d711 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:43.056118 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0e91624-e4c6-4a0e-ad0a-45b92a21d711 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:43.057890 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b0e91624-e4c6-4a0e-ad0a-45b92a21d711 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:43.108308 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:43.144978 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=8 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:43.612546 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-b3b62d0b-1cb0-40b5-8a62-0ced084bd705 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:43.624182 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b3b62d0b-1cb0-40b5-8a62-0ced084bd705 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1322 microversion: 2.1 time: 0.846311 Oct 17 04:31:43.625712 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 32/72] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:42 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1322 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:43.637573 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e94e7b4b-2204-42a7-8948-8e9afea4763a req-6fdf5dce-b3e0-41a9-aa89-402916be8eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c34166-9c02-41cb-b5e6-21cc7c4b06b7", "name": "network-vif-plugged", "status": "completed", "tag": "62afe409-bc34-457e-bcb8-6b6ebb859ed6"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:43.653893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e94e7b4b-2204-42a7-8948-8e9afea4763a req-6fdf5dce-b3e0-41a9-aa89-402916be8eed service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:43.655164 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e94e7b4b-2204-42a7-8948-8e9afea4763a req-6fdf5dce-b3e0-41a9-aa89-402916be8eed service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:43.655792 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e94e7b4b-2204-42a7-8948-8e9afea4763a req-6fdf5dce-b3e0-41a9-aa89-402916be8eed service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:43.670497 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e94e7b4b-2204-42a7-8948-8e9afea4763a req-6fdf5dce-b3e0-41a9-aa89-402916be8eed service nova] Creating event network-vif-plugged:62afe409-bc34-457e-bcb8-6b6ebb859ed6 for instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 on hv-cinder-86155 Oct 17 04:31:43.671534 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b0e91624-e4c6-4a0e-ad0a-45b92a21d711 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:43.677480 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e94e7b4b-2204-42a7-8948-8e9afea4763a req-6fdf5dce-b3e0-41a9-aa89-402916be8eed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050104 Oct 17 04:31:43.678091 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 33/73] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:31:43.685082 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b0e91624-e4c6-4a0e-ad0a-45b92a21d711 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1315 microversion: 2.1 time: 0.649215 Oct 17 04:31:43.685804 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 41/74] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:43 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:43.687184 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f33cf717-2021-4e51-8d1a-234a38764c5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:43.687888 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f33cf717-2021-4e51-8d1a-234a38764c5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:43.694190 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f33cf717-2021-4e51-8d1a-234a38764c5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:43.694748 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f33cf717-2021-4e51-8d1a-234a38764c5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:43.695171 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f33cf717-2021-4e51-8d1a-234a38764c5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:43.696023 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f33cf717-2021-4e51-8d1a-234a38764c5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:43.696472 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f33cf717-2021-4e51-8d1a-234a38764c5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:43.696891 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f33cf717-2021-4e51-8d1a-234a38764c5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:43.789612 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-35216841-1d46-4478-9d2e-e75c74ab4616 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:43.790374 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-35216841-1d46-4478-9d2e-e75c74ab4616 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:43.806418 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35216841-1d46-4478-9d2e-e75c74ab4616 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:43.807107 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35216841-1d46-4478-9d2e-e75c74ab4616 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:43.807565 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35216841-1d46-4478-9d2e-e75c74ab4616 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:43.808280 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35216841-1d46-4478-9d2e-e75c74ab4616 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:43.808886 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35216841-1d46-4478-9d2e-e75c74ab4616 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:43.809541 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35216841-1d46-4478-9d2e-e75c74ab4616 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:43.884132 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f33cf717-2021-4e51-8d1a-234a38764c5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:43.895902 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f33cf717-2021-4e51-8d1a-234a38764c5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:43.897986 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f33cf717-2021-4e51-8d1a-234a38764c5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:43.899613 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f33cf717-2021-4e51-8d1a-234a38764c5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1407 microversion: 2.20 time: 0.220078 Oct 17 04:31:43.900364 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 34/75] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:31:43 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:31:43.982480 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-35216841-1d46-4478-9d2e-e75c74ab4616 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:43.991587 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-35216841-1d46-4478-9d2e-e75c74ab4616 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1366 microversion: 2.1 time: 0.206760 Oct 17 04:31:43.992170 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 42/76] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:43 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:44.061621 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2badec9e-98d1-43c3-b8bf-ea8b6f5290a0 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:44.062242 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2badec9e-98d1-43c3-b8bf-ea8b6f5290a0 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:44.068048 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2badec9e-98d1-43c3-b8bf-ea8b6f5290a0 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:44.068577 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2badec9e-98d1-43c3-b8bf-ea8b6f5290a0 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:44.069043 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2badec9e-98d1-43c3-b8bf-ea8b6f5290a0 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:44.069734 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2badec9e-98d1-43c3-b8bf-ea8b6f5290a0 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:44.089728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2badec9e-98d1-43c3-b8bf-ea8b6f5290a0 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:44.090261 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2badec9e-98d1-43c3-b8bf-ea8b6f5290a0 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:44.355300 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-2badec9e-98d1-43c3-b8bf-ea8b6f5290a0 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:44.369831 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2badec9e-98d1-43c3-b8bf-ea8b6f5290a0 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1363 microversion: 2.1 time: 0.311727 Oct 17 04:31:44.381103 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 35/77] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:44 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:44.647145 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0a49a616-1cff-4778-815b-9a29cd20e9e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:44.647777 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0a49a616-1cff-4778-815b-9a29cd20e9e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:44.654374 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a49a616-1cff-4778-815b-9a29cd20e9e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:44.654980 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a49a616-1cff-4778-815b-9a29cd20e9e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:44.655658 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a49a616-1cff-4778-815b-9a29cd20e9e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:44.656471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a49a616-1cff-4778-815b-9a29cd20e9e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:44.656981 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a49a616-1cff-4778-815b-9a29cd20e9e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:44.657518 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a49a616-1cff-4778-815b-9a29cd20e9e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:44.708478 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f64acdda-39f3-4404-9146-937e1121db4d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:44.709366 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f64acdda-39f3-4404-9146-937e1121db4d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:44.716177 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f64acdda-39f3-4404-9146-937e1121db4d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:44.716997 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f64acdda-39f3-4404-9146-937e1121db4d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:44.717652 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f64acdda-39f3-4404-9146-937e1121db4d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:44.718566 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f64acdda-39f3-4404-9146-937e1121db4d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:44.719213 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f64acdda-39f3-4404-9146-937e1121db4d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:44.719872 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f64acdda-39f3-4404-9146-937e1121db4d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:45.071487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-0a49a616-1cff-4778-815b-9a29cd20e9e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:45.081362 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0a49a616-1cff-4778-815b-9a29cd20e9e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1322 microversion: 2.1 time: 0.438314 Oct 17 04:31:45.093956 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 43/78] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:44 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:45.099780 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f64acdda-39f3-4404-9146-937e1121db4d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:45.109195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e542ba15-2f89-4067-8315-b9b687ef8d51 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:45.110262 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f64acdda-39f3-4404-9146-937e1121db4d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1315 microversion: 2.1 time: 0.406089 Oct 17 04:31:45.112057 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e542ba15-2f89-4067-8315-b9b687ef8d51 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:45.125777 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 36/79] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:44 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:31:45.140751 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e542ba15-2f89-4067-8315-b9b687ef8d51 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:45.141363 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e542ba15-2f89-4067-8315-b9b687ef8d51 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:45.141795 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e542ba15-2f89-4067-8315-b9b687ef8d51 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:45.142650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e542ba15-2f89-4067-8315-b9b687ef8d51 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:45.143906 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e542ba15-2f89-4067-8315-b9b687ef8d51 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:45.144543 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e542ba15-2f89-4067-8315-b9b687ef8d51 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:45.144923 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-23249bbe-63eb-4829-88a0-c2504582667c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:45.145574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-23249bbe-63eb-4829-88a0-c2504582667c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:45.159271 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23249bbe-63eb-4829-88a0-c2504582667c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:45.159766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23249bbe-63eb-4829-88a0-c2504582667c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:45.160207 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23249bbe-63eb-4829-88a0-c2504582667c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:45.160910 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23249bbe-63eb-4829-88a0-c2504582667c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:45.161395 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23249bbe-63eb-4829-88a0-c2504582667c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:45.161823 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23249bbe-63eb-4829-88a0-c2504582667c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:45.415149 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e542ba15-2f89-4067-8315-b9b687ef8d51 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:45.421298 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-23249bbe-63eb-4829-88a0-c2504582667c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:45.427428 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e542ba15-2f89-4067-8315-b9b687ef8d51 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:45.430662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e542ba15-2f89-4067-8315-b9b687ef8d51 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:45.433609 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e542ba15-2f89-4067-8315-b9b687ef8d51 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1407 microversion: 2.20 time: 0.338450 Oct 17 04:31:45.434551 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 44/80] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:31:45 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:31:45.435281 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-23249bbe-63eb-4829-88a0-c2504582667c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1366 microversion: 2.1 time: 0.307912 Oct 17 04:31:45.452550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 37/81] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:45 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:45.452958 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1301ab25-890b-42e0-8434-55fdc2cde204 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:45.453914 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1301ab25-890b-42e0-8434-55fdc2cde204 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:45.461438 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1301ab25-890b-42e0-8434-55fdc2cde204 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:45.462222 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1301ab25-890b-42e0-8434-55fdc2cde204 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:45.463424 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1301ab25-890b-42e0-8434-55fdc2cde204 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:45.464403 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1301ab25-890b-42e0-8434-55fdc2cde204 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:45.465313 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1301ab25-890b-42e0-8434-55fdc2cde204 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:45.466068 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1301ab25-890b-42e0-8434-55fdc2cde204 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:45.660597 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-1301ab25-890b-42e0-8434-55fdc2cde204 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:45.671804 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1301ab25-890b-42e0-8434-55fdc2cde204 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1363 microversion: 2.1 time: 0.230847 Oct 17 04:31:45.672590 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 45/82] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:45 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:45.694227 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-c9e45cf0-7674-4d16-a033-74ffcfa4a16d req-d9c9b687-3cb6-4b74-92b8-4629c64c02b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee04d43c-6d11-4571-989e-90ee8175e03d", "name": "network-vif-plugged", "status": "completed", "tag": "f63f40c8-b445-4c27-a582-2ac29415fbeb"}, {"server_uuid": "942796c5-f5b3-476a-ae21-dcaabf3bd8df", "name": "network-vif-plugged", "status": "completed", "tag": "37d6f19d-2ed4-4803-ac7c-8e9517972bc6"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:45.708832 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c9e45cf0-7674-4d16-a033-74ffcfa4a16d req-d9c9b687-3cb6-4b74-92b8-4629c64c02b6 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:45.709480 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c9e45cf0-7674-4d16-a033-74ffcfa4a16d req-d9c9b687-3cb6-4b74-92b8-4629c64c02b6 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:45.709768 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c9e45cf0-7674-4d16-a033-74ffcfa4a16d req-d9c9b687-3cb6-4b74-92b8-4629c64c02b6 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:45.733213 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-c9e45cf0-7674-4d16-a033-74ffcfa4a16d req-d9c9b687-3cb6-4b74-92b8-4629c64c02b6 service nova] Creating event network-vif-plugged:f63f40c8-b445-4c27-a582-2ac29415fbeb for instance ee04d43c-6d11-4571-989e-90ee8175e03d on hv-cinder-86155 Oct 17 04:31:45.733213 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-c9e45cf0-7674-4d16-a033-74ffcfa4a16d req-d9c9b687-3cb6-4b74-92b8-4629c64c02b6 service nova] Creating event network-vif-plugged:37d6f19d-2ed4-4803-ac7c-8e9517972bc6 for instance 942796c5-f5b3-476a-ae21-dcaabf3bd8df on hv-cinder-86155 Oct 17 04:31:45.746492 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-c9e45cf0-7674-4d16-a033-74ffcfa4a16d req-d9c9b687-3cb6-4b74-92b8-4629c64c02b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057079 Oct 17 04:31:45.747452 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 38/83] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:31:46.105902 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5a33d112-14cd-4c3b-98e2-c2c86c6a088b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:46.107415 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5a33d112-14cd-4c3b-98e2-c2c86c6a088b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:46.117352 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:46.121267 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a33d112-14cd-4c3b-98e2-c2c86c6a088b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:46.121989 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a33d112-14cd-4c3b-98e2-c2c86c6a088b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:46.123228 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a33d112-14cd-4c3b-98e2-c2c86c6a088b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:46.124175 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a33d112-14cd-4c3b-98e2-c2c86c6a088b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:46.133931 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a33d112-14cd-4c3b-98e2-c2c86c6a088b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:46.134899 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a33d112-14cd-4c3b-98e2-c2c86c6a088b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:46.141301 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b122e618-85f1-49bd-bdbd-efc27fed7574 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:46.142873 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b122e618-85f1-49bd-bdbd-efc27fed7574 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:46.164157 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b122e618-85f1-49bd-bdbd-efc27fed7574 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:46.166894 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b122e618-85f1-49bd-bdbd-efc27fed7574 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:46.168099 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b122e618-85f1-49bd-bdbd-efc27fed7574 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:46.169715 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b122e618-85f1-49bd-bdbd-efc27fed7574 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:46.170192 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b122e618-85f1-49bd-bdbd-efc27fed7574 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:46.175293 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b122e618-85f1-49bd-bdbd-efc27fed7574 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:46.525430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5a33d112-14cd-4c3b-98e2-c2c86c6a088b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:46.536351 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5a33d112-14cd-4c3b-98e2-c2c86c6a088b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1322 microversion: 2.1 time: 0.434433 Oct 17 04:31:46.553046 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 46/84] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:46 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1322 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:46.559574 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9d2253dd-40f5-47ff-bc7f-0d513e879b56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:46.560521 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9d2253dd-40f5-47ff-bc7f-0d513e879b56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:46.567588 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d2253dd-40f5-47ff-bc7f-0d513e879b56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:46.568291 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d2253dd-40f5-47ff-bc7f-0d513e879b56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:46.569204 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d2253dd-40f5-47ff-bc7f-0d513e879b56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:46.570133 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d2253dd-40f5-47ff-bc7f-0d513e879b56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:46.570768 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d2253dd-40f5-47ff-bc7f-0d513e879b56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:46.571480 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9d2253dd-40f5-47ff-bc7f-0d513e879b56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:46.575744 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-b122e618-85f1-49bd-bdbd-efc27fed7574 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:46.585972 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b122e618-85f1-49bd-bdbd-efc27fed7574 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1315 microversion: 2.1 time: 0.452544 Oct 17 04:31:46.586531 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 39/85] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:46 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:46.601529 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3a0b4fd1-3151-40e7-a1b2-16d7478f4345 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:46.607009 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3a0b4fd1-3151-40e7-a1b2-16d7478f4345 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:46.614610 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a0b4fd1-3151-40e7-a1b2-16d7478f4345 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:46.616052 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a0b4fd1-3151-40e7-a1b2-16d7478f4345 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:46.616852 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a0b4fd1-3151-40e7-a1b2-16d7478f4345 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:46.617952 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a0b4fd1-3151-40e7-a1b2-16d7478f4345 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:46.619965 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a0b4fd1-3151-40e7-a1b2-16d7478f4345 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:46.620615 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3a0b4fd1-3151-40e7-a1b2-16d7478f4345 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:46.986045 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3a0b4fd1-3151-40e7-a1b2-16d7478f4345 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:46.989836 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-9d2253dd-40f5-47ff-bc7f-0d513e879b56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:46.996315 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3a0b4fd1-3151-40e7-a1b2-16d7478f4345 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1366 microversion: 2.1 time: 0.401697 Oct 17 04:31:46.996987 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 40/86] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:46 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1366 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:46.999065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-9d2253dd-40f5-47ff-bc7f-0d513e879b56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:47.001612 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-9d2253dd-40f5-47ff-bc7f-0d513e879b56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:47.002774 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9d2253dd-40f5-47ff-bc7f-0d513e879b56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1407 microversion: 2.20 time: 0.448302 Oct 17 04:31:47.005422 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 47/87] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:31:46 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1407 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:31:47.007298 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bdb4a25c-f629-4637-ad20-e629018abb3d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:47.007923 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bdb4a25c-f629-4637-ad20-e629018abb3d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:47.014247 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bdb4a25c-f629-4637-ad20-e629018abb3d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:47.014805 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bdb4a25c-f629-4637-ad20-e629018abb3d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:47.015307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bdb4a25c-f629-4637-ad20-e629018abb3d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:47.016070 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bdb4a25c-f629-4637-ad20-e629018abb3d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:47.016658 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bdb4a25c-f629-4637-ad20-e629018abb3d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:47.017189 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bdb4a25c-f629-4637-ad20-e629018abb3d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:47.219943 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-bdb4a25c-f629-4637-ad20-e629018abb3d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:47.236941 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bdb4a25c-f629-4637-ad20-e629018abb3d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1363 microversion: 2.1 time: 0.238711 Oct 17 04:31:47.240610 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 41/88] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:46 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:47.561964 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-93c5dea4-9511-46f0-8bac-9016d2a08c70 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:47.562719 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-93c5dea4-9511-46f0-8bac-9016d2a08c70 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:47.569630 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93c5dea4-9511-46f0-8bac-9016d2a08c70 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:47.570364 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93c5dea4-9511-46f0-8bac-9016d2a08c70 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:47.571003 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93c5dea4-9511-46f0-8bac-9016d2a08c70 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:47.571778 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93c5dea4-9511-46f0-8bac-9016d2a08c70 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:47.573030 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93c5dea4-9511-46f0-8bac-9016d2a08c70 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:47.573732 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93c5dea4-9511-46f0-8bac-9016d2a08c70 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:47.615682 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8edb20c3-a0f7-48cd-9629-4e304ceafa21 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:47.616330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8edb20c3-a0f7-48cd-9629-4e304ceafa21 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:47.627612 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8edb20c3-a0f7-48cd-9629-4e304ceafa21 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:47.628107 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8edb20c3-a0f7-48cd-9629-4e304ceafa21 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:47.628553 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8edb20c3-a0f7-48cd-9629-4e304ceafa21 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:47.629313 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8edb20c3-a0f7-48cd-9629-4e304ceafa21 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:47.629854 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8edb20c3-a0f7-48cd-9629-4e304ceafa21 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:47.630337 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8edb20c3-a0f7-48cd-9629-4e304ceafa21 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:47.799328 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-93c5dea4-9511-46f0-8bac-9016d2a08c70 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:47.815281 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-93c5dea4-9511-46f0-8bac-9016d2a08c70 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1322 microversion: 2.1 time: 0.258468 Oct 17 04:31:47.818808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 48/89] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:47 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:47.912149 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-8edb20c3-a0f7-48cd-9629-4e304ceafa21 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:47.921430 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8edb20c3-a0f7-48cd-9629-4e304ceafa21 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1502 microversion: 2.1 time: 0.310308 Oct 17 04:31:47.922011 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 42/90] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:47 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1502 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:48.019819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-580f9967-a760-4508-9c68-b3930d7341a7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:48.020992 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-580f9967-a760-4508-9c68-b3930d7341a7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:48.029848 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f8c7962a-9b9d-43d4-afd9-030708cec4d9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:48.031073 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f8c7962a-9b9d-43d4-afd9-030708cec4d9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:48.032061 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-580f9967-a760-4508-9c68-b3930d7341a7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:48.034806 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-580f9967-a760-4508-9c68-b3930d7341a7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:48.035694 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-580f9967-a760-4508-9c68-b3930d7341a7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:48.037699 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-580f9967-a760-4508-9c68-b3930d7341a7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:48.038138 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8c7962a-9b9d-43d4-afd9-030708cec4d9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:48.039566 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-580f9967-a760-4508-9c68-b3930d7341a7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:48.040194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8c7962a-9b9d-43d4-afd9-030708cec4d9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:48.040479 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-580f9967-a760-4508-9c68-b3930d7341a7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:48.041340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8c7962a-9b9d-43d4-afd9-030708cec4d9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:48.042373 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8c7962a-9b9d-43d4-afd9-030708cec4d9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:48.043617 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8c7962a-9b9d-43d4-afd9-030708cec4d9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:48.044328 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8c7962a-9b9d-43d4-afd9-030708cec4d9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:48.294261 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-580f9967-a760-4508-9c68-b3930d7341a7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:48.305344 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-580f9967-a760-4508-9c68-b3930d7341a7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1366 microversion: 2.1 time: 0.289419 Oct 17 04:31:48.307852 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 49/91] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:48 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:48.325263 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-35f3bd8b-a506-4939-becf-3cfc45574767 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:48.326048 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-35f3bd8b-a506-4939-becf-3cfc45574767 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:48.330500 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f8c7962a-9b9d-43d4-afd9-030708cec4d9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:48.339176 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35f3bd8b-a506-4939-becf-3cfc45574767 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:48.341555 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f8c7962a-9b9d-43d4-afd9-030708cec4d9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:48.344170 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35f3bd8b-a506-4939-becf-3cfc45574767 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:48.345523 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35f3bd8b-a506-4939-becf-3cfc45574767 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:48.348052 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f8c7962a-9b9d-43d4-afd9-030708cec4d9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:48.348323 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35f3bd8b-a506-4939-becf-3cfc45574767 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:48.348967 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35f3bd8b-a506-4939-becf-3cfc45574767 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:48.350483 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f8c7962a-9b9d-43d4-afd9-030708cec4d9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1407 microversion: 2.20 time: 0.326337 Oct 17 04:31:48.351157 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35f3bd8b-a506-4939-becf-3cfc45574767 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:48.352948 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 43/92] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:31:48 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:31:48.544229 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-35f3bd8b-a506-4939-becf-3cfc45574767 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:48.553599 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-35f3bd8b-a506-4939-becf-3cfc45574767 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1363 microversion: 2.1 time: 0.243092 Oct 17 04:31:48.554206 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 50/93] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:48 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:48.851653 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3eec7c0f-f704-4ce1-aac8-b4f042c6d36b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:48.852530 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3eec7c0f-f704-4ce1-aac8-b4f042c6d36b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:48.860362 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3eec7c0f-f704-4ce1-aac8-b4f042c6d36b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:48.860934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3eec7c0f-f704-4ce1-aac8-b4f042c6d36b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:48.861474 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3eec7c0f-f704-4ce1-aac8-b4f042c6d36b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:48.862237 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3eec7c0f-f704-4ce1-aac8-b4f042c6d36b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:48.862943 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3eec7c0f-f704-4ce1-aac8-b4f042c6d36b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:48.863565 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3eec7c0f-f704-4ce1-aac8-b4f042c6d36b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:48.868282 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:49.063612 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3eec7c0f-f704-4ce1-aac8-b4f042c6d36b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:49.081821 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3eec7c0f-f704-4ce1-aac8-b4f042c6d36b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1515 microversion: 2.1 time: 0.239193 Oct 17 04:31:49.083535 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 44/94] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:48 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1515 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:49.109050 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3a0e6701-a9a5-4d3f-ac9c-fc6cb2ba7ca8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:49.111404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3a0e6701-a9a5-4d3f-ac9c-fc6cb2ba7ca8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:49.120205 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a0e6701-a9a5-4d3f-ac9c-fc6cb2ba7ca8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:49.121028 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a0e6701-a9a5-4d3f-ac9c-fc6cb2ba7ca8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:49.121708 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a0e6701-a9a5-4d3f-ac9c-fc6cb2ba7ca8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:49.122630 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a0e6701-a9a5-4d3f-ac9c-fc6cb2ba7ca8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:49.123290 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a0e6701-a9a5-4d3f-ac9c-fc6cb2ba7ca8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:49.123927 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a0e6701-a9a5-4d3f-ac9c-fc6cb2ba7ca8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:49.187918 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-a4d63816-0cd2-4482-b0ed-b5d5efa3d153 req-6c5a5194-f6c7-41b9-a342-0856a429acf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc759c8-a208-4df1-bf3e-dd2b89bff369", "name": "network-vif-plugged", "status": "completed", "tag": "96c8acae-b8cc-4eed-af97-bcefcfe399c5"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:49.196542 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-3a0e6701-a9a5-4d3f-ac9c-fc6cb2ba7ca8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lazy-loading 'flavor' on Instance uuid 942796c5-f5b3-476a-ae21-dcaabf3bd8df {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:31:49.221943 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a4d63816-0cd2-4482-b0ed-b5d5efa3d153 req-6c5a5194-f6c7-41b9-a342-0856a429acf3 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:49.221943 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a4d63816-0cd2-4482-b0ed-b5d5efa3d153 req-6c5a5194-f6c7-41b9-a342-0856a429acf3 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:49.222917 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-a4d63816-0cd2-4482-b0ed-b5d5efa3d153 req-6c5a5194-f6c7-41b9-a342-0856a429acf3 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:49.255504 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-a4d63816-0cd2-4482-b0ed-b5d5efa3d153 req-6c5a5194-f6c7-41b9-a342-0856a429acf3 service nova] Creating event network-vif-plugged:96c8acae-b8cc-4eed-af97-bcefcfe399c5 for instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 on hv-cinder-86155 Oct 17 04:31:49.270151 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-a4d63816-0cd2-4482-b0ed-b5d5efa3d153 req-6c5a5194-f6c7-41b9-a342-0856a429acf3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087345 Oct 17 04:31:49.272664 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 45/95] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:31:49.335751 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fd91a493-d453-4521-aeaa-2e9d66165b08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:49.336456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fd91a493-d453-4521-aeaa-2e9d66165b08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:49.351112 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd91a493-d453-4521-aeaa-2e9d66165b08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:49.351752 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd91a493-d453-4521-aeaa-2e9d66165b08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:49.352192 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd91a493-d453-4521-aeaa-2e9d66165b08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:49.360211 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd91a493-d453-4521-aeaa-2e9d66165b08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:49.360866 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd91a493-d453-4521-aeaa-2e9d66165b08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:49.361726 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fd91a493-d453-4521-aeaa-2e9d66165b08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:49.433682 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3a0e6701-a9a5-4d3f-ac9c-fc6cb2ba7ca8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "POST /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df/action" status: 200 len: 32 microversion: 2.1 time: 0.330138 Oct 17 04:31:49.441202 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 51/96] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Oct 17 04:31:49 2022] POST /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df/action => generated 32 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 04:31:49.448913 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-30142cab-f463-4b5a-a366-a23ced1d598d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:49.450386 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-30142cab-f463-4b5a-a366-a23ced1d598d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:49.459542 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30142cab-f463-4b5a-a366-a23ced1d598d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:49.460400 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30142cab-f463-4b5a-a366-a23ced1d598d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:49.474049 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30142cab-f463-4b5a-a366-a23ced1d598d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:49.475223 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30142cab-f463-4b5a-a366-a23ced1d598d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:49.475765 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30142cab-f463-4b5a-a366-a23ced1d598d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:49.476217 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-30142cab-f463-4b5a-a366-a23ced1d598d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:49.712721 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-fd91a493-d453-4521-aeaa-2e9d66165b08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:49.724712 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fd91a493-d453-4521-aeaa-2e9d66165b08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1366 microversion: 2.1 time: 0.394242 Oct 17 04:31:49.726765 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 46/97] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:49 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:49.741696 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8ebc7db6-86a9-4080-927c-4f100eb414da tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:49.743956 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8ebc7db6-86a9-4080-927c-4f100eb414da tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:49.757792 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ebc7db6-86a9-4080-927c-4f100eb414da tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:49.760748 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ebc7db6-86a9-4080-927c-4f100eb414da tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:49.761335 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ebc7db6-86a9-4080-927c-4f100eb414da tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:49.762171 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ebc7db6-86a9-4080-927c-4f100eb414da tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:49.764638 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ebc7db6-86a9-4080-927c-4f100eb414da tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:49.765231 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ebc7db6-86a9-4080-927c-4f100eb414da tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:49.854006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-30142cab-f463-4b5a-a366-a23ced1d598d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:49.867017 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-30142cab-f463-4b5a-a366-a23ced1d598d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:49.874125 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-30142cab-f463-4b5a-a366-a23ced1d598d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:49.875774 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-30142cab-f463-4b5a-a366-a23ced1d598d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1598 microversion: 2.20 time: 0.432013 Oct 17 04:31:49.876531 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 52/98] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:31:49 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1598 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:31:49.881585 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3dea6777-78fc-421d-b345-22f5db84a5e6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e619b7d8-1c34-4bdb-bf4c-065038941953"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:49.889024 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3dea6777-78fc-421d-b345-22f5db84a5e6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:49.904922 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3dea6777-78fc-421d-b345-22f5db84a5e6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:49.906149 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3dea6777-78fc-421d-b345-22f5db84a5e6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:49.906149 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3dea6777-78fc-421d-b345-22f5db84a5e6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:49.910947 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3dea6777-78fc-421d-b345-22f5db84a5e6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:49.911614 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3dea6777-78fc-421d-b345-22f5db84a5e6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:49.912150 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3dea6777-78fc-421d-b345-22f5db84a5e6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:49.993150 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-8ebc7db6-86a9-4080-927c-4f100eb414da tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:50.004837 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8ebc7db6-86a9-4080-927c-4f100eb414da tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.276521 Oct 17 04:31:50.007765 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 47/99] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:49 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:50.026073 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c74dbff2-4d07-4485-bcee-f43201c70fbf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:50.026699 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c74dbff2-4d07-4485-bcee-f43201c70fbf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:50.039950 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c74dbff2-4d07-4485-bcee-f43201c70fbf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:50.040542 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c74dbff2-4d07-4485-bcee-f43201c70fbf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:50.042463 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c74dbff2-4d07-4485-bcee-f43201c70fbf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:50.044116 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c74dbff2-4d07-4485-bcee-f43201c70fbf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:50.046800 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c74dbff2-4d07-4485-bcee-f43201c70fbf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:50.047657 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c74dbff2-4d07-4485-bcee-f43201c70fbf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:50.206615 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-c74dbff2-4d07-4485-bcee-f43201c70fbf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:50.217132 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c74dbff2-4d07-4485-bcee-f43201c70fbf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1363 microversion: 2.1 time: 0.200407 Oct 17 04:31:50.218541 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 48/100] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:50 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:50.224428 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ae0c4cc5-d37b-43d9-b7c0-421da7033d5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:50.225250 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ae0c4cc5-d37b-43d9-b7c0-421da7033d5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:50.232542 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae0c4cc5-d37b-43d9-b7c0-421da7033d5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:50.233375 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae0c4cc5-d37b-43d9-b7c0-421da7033d5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:50.234213 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae0c4cc5-d37b-43d9-b7c0-421da7033d5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:50.235288 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae0c4cc5-d37b-43d9-b7c0-421da7033d5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:50.235956 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae0c4cc5-d37b-43d9-b7c0-421da7033d5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:50.236679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae0c4cc5-d37b-43d9-b7c0-421da7033d5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:50.423424 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ae0c4cc5-d37b-43d9-b7c0-421da7033d5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.203276 Oct 17 04:31:50.424102 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 49/101] 10.222.0.40 () {60 vars in 1316 bytes} [Mon Oct 17 04:31:50 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 04:31:50.498896 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3dea6777-78fc-421d-b345-22f5db84a5e6 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "POST /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.620432 Oct 17 04:31:50.499531 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 53/102] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Oct 17 04:31:49 2022] POST /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7/os-volume_attachments => generated 194 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:31:50.748557 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-88418ca7-2674-4361-b48f-b30246c3b403 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:50.749699 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-88418ca7-2674-4361-b48f-b30246c3b403 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:50.755889 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88418ca7-2674-4361-b48f-b30246c3b403 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:50.756815 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88418ca7-2674-4361-b48f-b30246c3b403 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:50.757569 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88418ca7-2674-4361-b48f-b30246c3b403 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:50.759346 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88418ca7-2674-4361-b48f-b30246c3b403 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:50.760260 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88418ca7-2674-4361-b48f-b30246c3b403 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:50.760769 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88418ca7-2674-4361-b48f-b30246c3b403 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:50.945544 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-88418ca7-2674-4361-b48f-b30246c3b403 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:50.955273 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-88418ca7-2674-4361-b48f-b30246c3b403 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1366 microversion: 2.1 time: 0.211028 Oct 17 04:31:50.955889 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 50/103] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:50 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:51.033746 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8466c02c-176a-4c7f-b038-ba49b0735948 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:51.034523 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8466c02c-176a-4c7f-b038-ba49b0735948 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:51.040826 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8466c02c-176a-4c7f-b038-ba49b0735948 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:51.042579 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8466c02c-176a-4c7f-b038-ba49b0735948 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:51.043630 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8466c02c-176a-4c7f-b038-ba49b0735948 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:51.044343 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8466c02c-176a-4c7f-b038-ba49b0735948 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:51.044795 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8466c02c-176a-4c7f-b038-ba49b0735948 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:51.045246 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8466c02c-176a-4c7f-b038-ba49b0735948 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:51.066257 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:51.244617 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b50b4d3b-e19a-4391-b1f4-cad593888c99 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:51.246202 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b50b4d3b-e19a-4391-b1f4-cad593888c99 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:51.257027 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b50b4d3b-e19a-4391-b1f4-cad593888c99 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:51.259825 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b50b4d3b-e19a-4391-b1f4-cad593888c99 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:51.261588 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b50b4d3b-e19a-4391-b1f4-cad593888c99 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:51.262696 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b50b4d3b-e19a-4391-b1f4-cad593888c99 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:51.266678 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b50b4d3b-e19a-4391-b1f4-cad593888c99 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:51.267496 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b50b4d3b-e19a-4391-b1f4-cad593888c99 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:51.503560 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-8466c02c-176a-4c7f-b038-ba49b0735948 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:51.516787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8466c02c-176a-4c7f-b038-ba49b0735948 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.487099 Oct 17 04:31:51.517720 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 54/104] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:51 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:51.522406 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-fc794496-0c5a-48ca-bf00-3daf47a29ee8 req-cdc2cccd-c2b1-4c1d-9a85-081f8c1181b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf59bfb1-79b1-4ebe-9635-380231dec617", "name": "network-vif-plugged", "status": "completed", "tag": "1b48d51f-4326-473b-8c9d-416ea81fac1e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:51.532390 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fc794496-0c5a-48ca-bf00-3daf47a29ee8 req-cdc2cccd-c2b1-4c1d-9a85-081f8c1181b6 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:51.533228 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fc794496-0c5a-48ca-bf00-3daf47a29ee8 req-cdc2cccd-c2b1-4c1d-9a85-081f8c1181b6 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:51.533894 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fc794496-0c5a-48ca-bf00-3daf47a29ee8 req-cdc2cccd-c2b1-4c1d-9a85-081f8c1181b6 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:51.546071 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-fc794496-0c5a-48ca-bf00-3daf47a29ee8 req-cdc2cccd-c2b1-4c1d-9a85-081f8c1181b6 service nova] Creating event network-vif-plugged:1b48d51f-4326-473b-8c9d-416ea81fac1e for instance bf59bfb1-79b1-4ebe-9635-380231dec617 on hv-cinder-86155 Oct 17 04:31:51.552154 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-fc794496-0c5a-48ca-bf00-3daf47a29ee8 req-cdc2cccd-c2b1-4c1d-9a85-081f8c1181b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033003 Oct 17 04:31:51.552992 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 55/105] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:31:51.602200 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-b50b4d3b-e19a-4391-b1f4-cad593888c99 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:51.611264 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b50b4d3b-e19a-4391-b1f4-cad593888c99 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1363 microversion: 2.1 time: 0.371584 Oct 17 04:31:51.612598 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 51/106] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:51 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1363 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:51.982372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b3eba59b-ec14-4d0d-b575-944e8d0fedf1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:51.984089 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b3eba59b-ec14-4d0d-b575-944e8d0fedf1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:51.993824 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3eba59b-ec14-4d0d-b575-944e8d0fedf1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:51.997155 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3eba59b-ec14-4d0d-b575-944e8d0fedf1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:51.997155 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3eba59b-ec14-4d0d-b575-944e8d0fedf1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:51.998232 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3eba59b-ec14-4d0d-b575-944e8d0fedf1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:51.999087 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3eba59b-ec14-4d0d-b575-944e8d0fedf1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:51.999658 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3eba59b-ec14-4d0d-b575-944e8d0fedf1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:52.243419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b3eba59b-ec14-4d0d-b575-944e8d0fedf1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:52.253196 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b3eba59b-ec14-4d0d-b575-944e8d0fedf1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1556 microversion: 2.1 time: 0.278180 Oct 17 04:31:52.253794 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 56/107] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:51 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1556 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:52.278280 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fc7a9906-b7e9-4d43-8497-df42ea9943f3 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:52.278806 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fc7a9906-b7e9-4d43-8497-df42ea9943f3 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:52.285028 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc7a9906-b7e9-4d43-8497-df42ea9943f3 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:52.285725 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc7a9906-b7e9-4d43-8497-df42ea9943f3 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:52.286326 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc7a9906-b7e9-4d43-8497-df42ea9943f3 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:52.287172 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc7a9906-b7e9-4d43-8497-df42ea9943f3 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:52.287767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc7a9906-b7e9-4d43-8497-df42ea9943f3 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:52.288331 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fc7a9906-b7e9-4d43-8497-df42ea9943f3 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:52.376081 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fc7a9906-b7e9-4d43-8497-df42ea9943f3 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102236 Oct 17 04:31:52.377242 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 52/108] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Oct 17 04:31:52 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:31:52.545647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-13ba7341-7574-49b0-aef8-aa9515ad03c3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:52.546805 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-13ba7341-7574-49b0-aef8-aa9515ad03c3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:52.549651 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-7a2a0f55-6a7a-452c-b542-010212a6a80d req-911d0993-e1e6-431e-885e-377849c8955c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee04d43c-6d11-4571-989e-90ee8175e03d", "tag": "f63f40c8-b445-4c27-a582-2ac29415fbeb"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:52.552939 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13ba7341-7574-49b0-aef8-aa9515ad03c3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:52.553653 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13ba7341-7574-49b0-aef8-aa9515ad03c3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:52.554416 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13ba7341-7574-49b0-aef8-aa9515ad03c3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:52.555306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13ba7341-7574-49b0-aef8-aa9515ad03c3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:52.556444 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13ba7341-7574-49b0-aef8-aa9515ad03c3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:52.557735 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-13ba7341-7574-49b0-aef8-aa9515ad03c3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:52.569405 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7a2a0f55-6a7a-452c-b542-010212a6a80d req-911d0993-e1e6-431e-885e-377849c8955c service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:52.569923 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7a2a0f55-6a7a-452c-b542-010212a6a80d req-911d0993-e1e6-431e-885e-377849c8955c service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:52.570417 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7a2a0f55-6a7a-452c-b542-010212a6a80d req-911d0993-e1e6-431e-885e-377849c8955c service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:52.583721 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-7a2a0f55-6a7a-452c-b542-010212a6a80d req-911d0993-e1e6-431e-885e-377849c8955c service nova] Creating event network-changed:f63f40c8-b445-4c27-a582-2ac29415fbeb for instance ee04d43c-6d11-4571-989e-90ee8175e03d on hv-cinder-86155 Oct 17 04:31:52.589619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-7a2a0f55-6a7a-452c-b542-010212a6a80d req-911d0993-e1e6-431e-885e-377849c8955c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043774 Oct 17 04:31:52.590734 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 53/109] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:31:52.643050 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f129379d-a82e-4f99-a0ff-be9157646a1e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:52.644525 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f129379d-a82e-4f99-a0ff-be9157646a1e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:52.663170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f129379d-a82e-4f99-a0ff-be9157646a1e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:52.665366 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f129379d-a82e-4f99-a0ff-be9157646a1e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:52.670735 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f129379d-a82e-4f99-a0ff-be9157646a1e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:52.671722 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f129379d-a82e-4f99-a0ff-be9157646a1e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:52.673646 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f129379d-a82e-4f99-a0ff-be9157646a1e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:52.675159 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f129379d-a82e-4f99-a0ff-be9157646a1e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:52.843633 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-13ba7341-7574-49b0-aef8-aa9515ad03c3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:52.853139 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-13ba7341-7574-49b0-aef8-aa9515ad03c3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.314763 Oct 17 04:31:52.865929 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 57/110] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:52 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:52.994571 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f129379d-a82e-4f99-a0ff-be9157646a1e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:53.002938 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f129379d-a82e-4f99-a0ff-be9157646a1e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1363 microversion: 2.1 time: 0.369087 Oct 17 04:31:53.022214 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 54/111] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:52 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1363 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:31:53.880636 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d2ba4287-b042-4153-a2ac-e1a82e8a26b4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:53.882108 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d2ba4287-b042-4153-a2ac-e1a82e8a26b4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:53.892270 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d2ba4287-b042-4153-a2ac-e1a82e8a26b4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:53.893108 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d2ba4287-b042-4153-a2ac-e1a82e8a26b4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:53.893800 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d2ba4287-b042-4153-a2ac-e1a82e8a26b4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:53.894822 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d2ba4287-b042-4153-a2ac-e1a82e8a26b4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:53.895565 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d2ba4287-b042-4153-a2ac-e1a82e8a26b4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:53.896456 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d2ba4287-b042-4153-a2ac-e1a82e8a26b4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:54.029195 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6f482a62-625e-42c3-8f0a-bb45c25b47f2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:54.029991 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6f482a62-625e-42c3-8f0a-bb45c25b47f2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:54.037249 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f482a62-625e-42c3-8f0a-bb45c25b47f2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:54.037249 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f482a62-625e-42c3-8f0a-bb45c25b47f2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:54.037921 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f482a62-625e-42c3-8f0a-bb45c25b47f2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:54.038838 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f482a62-625e-42c3-8f0a-bb45c25b47f2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:54.039878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f482a62-625e-42c3-8f0a-bb45c25b47f2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:54.040385 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f482a62-625e-42c3-8f0a-bb45c25b47f2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:54.268716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-d2ba4287-b042-4153-a2ac-e1a82e8a26b4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:54.276888 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d2ba4287-b042-4153-a2ac-e1a82e8a26b4 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.401906 Oct 17 04:31:54.293756 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 58/112] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:53 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:54.301613 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-876ab668-eb52-4b06-b519-016e3f1f8c71 req-3fc4928c-aa20-4c76-be77-2ffcf14691d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc759c8-a208-4df1-bf3e-dd2b89bff369", "tag": "96c8acae-b8cc-4eed-af97-bcefcfe399c5"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:31:54.319965 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-6f482a62-625e-42c3-8f0a-bb45c25b47f2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:54.330043 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6f482a62-625e-42c3-8f0a-bb45c25b47f2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1363 microversion: 2.1 time: 0.305294 Oct 17 04:31:54.331350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 55/113] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:54 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:54.333454 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-876ab668-eb52-4b06-b519-016e3f1f8c71 req-3fc4928c-aa20-4c76-be77-2ffcf14691d9 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:54.335305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-876ab668-eb52-4b06-b519-016e3f1f8c71 req-3fc4928c-aa20-4c76-be77-2ffcf14691d9 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:54.336068 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-876ab668-eb52-4b06-b519-016e3f1f8c71 req-3fc4928c-aa20-4c76-be77-2ffcf14691d9 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:54.351491 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-876ab668-eb52-4b06-b519-016e3f1f8c71 req-3fc4928c-aa20-4c76-be77-2ffcf14691d9 service nova] Creating event network-changed:96c8acae-b8cc-4eed-af97-bcefcfe399c5 for instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 on hv-cinder-86155 Oct 17 04:31:54.363012 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-876ab668-eb52-4b06-b519-016e3f1f8c71 req-3fc4928c-aa20-4c76-be77-2ffcf14691d9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067544 Oct 17 04:31:54.364407 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 59/114] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:31:55.308214 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a2bc5622-30ac-4a1e-b1a1-b7429f686761 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:55.309055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a2bc5622-30ac-4a1e-b1a1-b7429f686761 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:55.315682 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a2bc5622-30ac-4a1e-b1a1-b7429f686761 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:55.316131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a2bc5622-30ac-4a1e-b1a1-b7429f686761 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:55.316563 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a2bc5622-30ac-4a1e-b1a1-b7429f686761 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:55.317296 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a2bc5622-30ac-4a1e-b1a1-b7429f686761 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:55.317752 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a2bc5622-30ac-4a1e-b1a1-b7429f686761 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:55.318184 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a2bc5622-30ac-4a1e-b1a1-b7429f686761 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:55.356069 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8a9578b8-f7ba-4629-bca6-143b92db4915 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:55.356784 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8a9578b8-f7ba-4629-bca6-143b92db4915 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:55.363914 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a9578b8-f7ba-4629-bca6-143b92db4915 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:55.364588 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a9578b8-f7ba-4629-bca6-143b92db4915 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:55.365259 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a9578b8-f7ba-4629-bca6-143b92db4915 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:55.366382 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a9578b8-f7ba-4629-bca6-143b92db4915 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:55.367268 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a9578b8-f7ba-4629-bca6-143b92db4915 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:55.367844 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a9578b8-f7ba-4629-bca6-143b92db4915 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:55.600777 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-a2bc5622-30ac-4a1e-b1a1-b7429f686761 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:55.608502 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a2bc5622-30ac-4a1e-b1a1-b7429f686761 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.304643 Oct 17 04:31:55.609089 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 56/115] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:55 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:55.627714 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-8a9578b8-f7ba-4629-bca6-143b92db4915 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:55.635854 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8a9578b8-f7ba-4629-bca6-143b92db4915 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1363 microversion: 2.1 time: 0.285547 Oct 17 04:31:55.636423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 60/116] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:55 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:31:56.630487 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3431c591-865d-453f-8d36-79cb25de188b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:56.631088 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3431c591-865d-453f-8d36-79cb25de188b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:56.637139 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3431c591-865d-453f-8d36-79cb25de188b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:56.637623 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3431c591-865d-453f-8d36-79cb25de188b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:56.638057 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3431c591-865d-453f-8d36-79cb25de188b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:56.638739 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3431c591-865d-453f-8d36-79cb25de188b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:56.639184 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3431c591-865d-453f-8d36-79cb25de188b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:56.639598 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3431c591-865d-453f-8d36-79cb25de188b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:56.658896 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c210a0fa-c562-4937-a05b-a62684a9f7dd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:56.659631 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c210a0fa-c562-4937-a05b-a62684a9f7dd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:56.662320 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=89 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:31:56.668744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c210a0fa-c562-4937-a05b-a62684a9f7dd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:56.669270 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c210a0fa-c562-4937-a05b-a62684a9f7dd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:56.669705 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c210a0fa-c562-4937-a05b-a62684a9f7dd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:56.670597 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c210a0fa-c562-4937-a05b-a62684a9f7dd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:56.671053 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c210a0fa-c562-4937-a05b-a62684a9f7dd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:56.671475 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c210a0fa-c562-4937-a05b-a62684a9f7dd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:56.853858 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3431c591-865d-453f-8d36-79cb25de188b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:56.861415 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3431c591-865d-453f-8d36-79cb25de188b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.234687 Oct 17 04:31:56.861988 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 57/117] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:56 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:56.870507 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c210a0fa-c562-4937-a05b-a62684a9f7dd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:56.878581 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c210a0fa-c562-4937-a05b-a62684a9f7dd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1363 microversion: 2.1 time: 0.223348 Oct 17 04:31:56.879241 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 61/118] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:56 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:31:57.885410 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-60a7c1b1-57db-41e1-8a87-412815fe9b03 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:57.886037 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-60a7c1b1-57db-41e1-8a87-412815fe9b03 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:57.891947 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60a7c1b1-57db-41e1-8a87-412815fe9b03 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:57.892457 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60a7c1b1-57db-41e1-8a87-412815fe9b03 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:57.892891 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60a7c1b1-57db-41e1-8a87-412815fe9b03 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:57.893610 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60a7c1b1-57db-41e1-8a87-412815fe9b03 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:57.894060 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60a7c1b1-57db-41e1-8a87-412815fe9b03 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:57.894482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60a7c1b1-57db-41e1-8a87-412815fe9b03 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:57.903084 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ed32daf1-6eef-4cdb-98da-0a3e9d4dfc85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:57.903756 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ed32daf1-6eef-4cdb-98da-0a3e9d4dfc85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:57.910179 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed32daf1-6eef-4cdb-98da-0a3e9d4dfc85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:57.910658 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed32daf1-6eef-4cdb-98da-0a3e9d4dfc85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:57.911094 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed32daf1-6eef-4cdb-98da-0a3e9d4dfc85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:57.911778 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed32daf1-6eef-4cdb-98da-0a3e9d4dfc85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:57.912230 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed32daf1-6eef-4cdb-98da-0a3e9d4dfc85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:57.912659 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ed32daf1-6eef-4cdb-98da-0a3e9d4dfc85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:58.091804 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-60a7c1b1-57db-41e1-8a87-412815fe9b03 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:58.099377 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-ed32daf1-6eef-4cdb-98da-0a3e9d4dfc85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:58.102337 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-60a7c1b1-57db-41e1-8a87-412815fe9b03 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.221008 Oct 17 04:31:58.102998 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 58/119] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:57 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:58.108223 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ed32daf1-6eef-4cdb-98da-0a3e9d4dfc85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1363 microversion: 2.1 time: 0.209741 Oct 17 04:31:58.111757 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 62/120] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:57 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:31:59.130838 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-398e55d9-40c0-4d17-8bc6-45754653af2d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:59.131443 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-398e55d9-40c0-4d17-8bc6-45754653af2d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:59.137784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dc682381-200d-4976-987a-2b999b758b8c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:31:59.137784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dc682381-200d-4976-987a-2b999b758b8c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:31:59.143070 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-398e55d9-40c0-4d17-8bc6-45754653af2d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:59.143569 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-398e55d9-40c0-4d17-8bc6-45754653af2d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:59.147169 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc682381-200d-4976-987a-2b999b758b8c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:59.147439 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-398e55d9-40c0-4d17-8bc6-45754653af2d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:59.147661 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc682381-200d-4976-987a-2b999b758b8c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:59.148098 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc682381-200d-4976-987a-2b999b758b8c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:59.148217 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-398e55d9-40c0-4d17-8bc6-45754653af2d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:59.148797 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc682381-200d-4976-987a-2b999b758b8c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:31:59.148897 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-398e55d9-40c0-4d17-8bc6-45754653af2d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:59.149277 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc682381-200d-4976-987a-2b999b758b8c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:31:59.149466 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-398e55d9-40c0-4d17-8bc6-45754653af2d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:59.149893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc682381-200d-4976-987a-2b999b758b8c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:31:59.341479 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-398e55d9-40c0-4d17-8bc6-45754653af2d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:59.345835 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-dc682381-200d-4976-987a-2b999b758b8c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:31:59.350662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-398e55d9-40c0-4d17-8bc6-45754653af2d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1363 microversion: 2.1 time: 0.222434 Oct 17 04:31:59.351316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 63/121] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:59 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:31:59.355075 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dc682381-200d-4976-987a-2b999b758b8c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.232569 Oct 17 04:31:59.355632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 59/122] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:31:59 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:00.374949 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4146b23c-f51d-4a07-8f1b-be7ddf14edbd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:00.375309 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4146b23c-f51d-4a07-8f1b-be7ddf14edbd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:00.379038 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1f71159d-7694-43a8-838e-4215c5323564 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:00.379654 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1f71159d-7694-43a8-838e-4215c5323564 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:00.381812 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4146b23c-f51d-4a07-8f1b-be7ddf14edbd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:00.382292 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4146b23c-f51d-4a07-8f1b-be7ddf14edbd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:00.382725 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4146b23c-f51d-4a07-8f1b-be7ddf14edbd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:00.383410 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4146b23c-f51d-4a07-8f1b-be7ddf14edbd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:00.383865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4146b23c-f51d-4a07-8f1b-be7ddf14edbd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:00.384284 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4146b23c-f51d-4a07-8f1b-be7ddf14edbd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:00.386387 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f71159d-7694-43a8-838e-4215c5323564 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:00.386876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f71159d-7694-43a8-838e-4215c5323564 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:00.387319 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f71159d-7694-43a8-838e-4215c5323564 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:00.388008 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f71159d-7694-43a8-838e-4215c5323564 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:00.388462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f71159d-7694-43a8-838e-4215c5323564 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:00.388892 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1f71159d-7694-43a8-838e-4215c5323564 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:00.577394 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-4146b23c-f51d-4a07-8f1b-be7ddf14edbd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:00.581267 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-1f71159d-7694-43a8-838e-4215c5323564 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:00.585486 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4146b23c-f51d-4a07-8f1b-be7ddf14edbd tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1548 microversion: 2.1 time: 0.214902 Oct 17 04:32:00.586063 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 64/123] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:00 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1548 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:00.589241 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1f71159d-7694-43a8-838e-4215c5323564 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.213931 Oct 17 04:32:00.589804 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 60/124] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:00 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:32:00.609093 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2727b1bc-a374-4dcd-b8a0-f8a1cb84f12d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:00.609630 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2727b1bc-a374-4dcd-b8a0-f8a1cb84f12d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:00.615401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2727b1bc-a374-4dcd-b8a0-f8a1cb84f12d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:00.615876 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2727b1bc-a374-4dcd-b8a0-f8a1cb84f12d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:00.616302 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2727b1bc-a374-4dcd-b8a0-f8a1cb84f12d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:00.616984 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2727b1bc-a374-4dcd-b8a0-f8a1cb84f12d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:00.617467 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2727b1bc-a374-4dcd-b8a0-f8a1cb84f12d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:00.617883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2727b1bc-a374-4dcd-b8a0-f8a1cb84f12d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:00.691972 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2727b1bc-a374-4dcd-b8a0-f8a1cb84f12d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086654 Oct 17 04:32:00.692598 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 65/125] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Oct 17 04:32:00 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:32:01.605750 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-ba6a53ef-6b68-4014-8db2-82652fda29d2 req-5e394de7-1693-42b3-94d4-9068d6e9a446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf59bfb1-79b1-4ebe-9635-380231dec617", "tag": "1b48d51f-4326-473b-8c9d-416ea81fac1e"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:32:01.611989 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-634c554a-4619-4d99-ad00-b4b0bd64b2ba tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:01.612667 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-634c554a-4619-4d99-ad00-b4b0bd64b2ba tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:01.615960 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ba6a53ef-6b68-4014-8db2-82652fda29d2 req-5e394de7-1693-42b3-94d4-9068d6e9a446 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:01.616510 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ba6a53ef-6b68-4014-8db2-82652fda29d2 req-5e394de7-1693-42b3-94d4-9068d6e9a446 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:01.617131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ba6a53ef-6b68-4014-8db2-82652fda29d2 req-5e394de7-1693-42b3-94d4-9068d6e9a446 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:01.619593 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-634c554a-4619-4d99-ad00-b4b0bd64b2ba tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:01.620606 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-634c554a-4619-4d99-ad00-b4b0bd64b2ba tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:01.621036 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-634c554a-4619-4d99-ad00-b4b0bd64b2ba tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:01.621897 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-634c554a-4619-4d99-ad00-b4b0bd64b2ba tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:01.622504 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-634c554a-4619-4d99-ad00-b4b0bd64b2ba tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:01.622923 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-634c554a-4619-4d99-ad00-b4b0bd64b2ba tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:01.631523 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-ba6a53ef-6b68-4014-8db2-82652fda29d2 req-5e394de7-1693-42b3-94d4-9068d6e9a446 service nova] Creating event network-changed:1b48d51f-4326-473b-8c9d-416ea81fac1e for instance bf59bfb1-79b1-4ebe-9635-380231dec617 on hv-cinder-86155 Oct 17 04:32:01.637543 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-ba6a53ef-6b68-4014-8db2-82652fda29d2 req-5e394de7-1693-42b3-94d4-9068d6e9a446 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035848 Oct 17 04:32:01.638347 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 61/126] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:32:01.760108 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-634c554a-4619-4d99-ad00-b4b0bd64b2ba tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:01.771927 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-634c554a-4619-4d99-ad00-b4b0bd64b2ba tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.164096 Oct 17 04:32:01.772684 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 66/127] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:01 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:32:02.796169 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8b5ce534-2f87-440f-8e08-1c1c51af76e5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:02.796919 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8b5ce534-2f87-440f-8e08-1c1c51af76e5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:02.803306 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b5ce534-2f87-440f-8e08-1c1c51af76e5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:02.803977 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b5ce534-2f87-440f-8e08-1c1c51af76e5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:02.804412 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b5ce534-2f87-440f-8e08-1c1c51af76e5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:02.805169 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b5ce534-2f87-440f-8e08-1c1c51af76e5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:02.805634 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b5ce534-2f87-440f-8e08-1c1c51af76e5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:02.806054 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8b5ce534-2f87-440f-8e08-1c1c51af76e5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:02.942384 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-8b5ce534-2f87-440f-8e08-1c1c51af76e5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:02.951472 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8b5ce534-2f87-440f-8e08-1c1c51af76e5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.159618 Oct 17 04:32:02.957859 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 62/128] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:02 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:03.974502 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c2828b8b-f704-4784-9583-e21e1f65fd21 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:03.975114 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c2828b8b-f704-4784-9583-e21e1f65fd21 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:03.983691 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2828b8b-f704-4784-9583-e21e1f65fd21 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:03.983691 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2828b8b-f704-4784-9583-e21e1f65fd21 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:03.983691 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2828b8b-f704-4784-9583-e21e1f65fd21 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:03.983691 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2828b8b-f704-4784-9583-e21e1f65fd21 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:03.984206 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2828b8b-f704-4784-9583-e21e1f65fd21 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:03.984521 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c2828b8b-f704-4784-9583-e21e1f65fd21 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:04.143406 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c2828b8b-f704-4784-9583-e21e1f65fd21 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:04.151787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c2828b8b-f704-4784-9583-e21e1f65fd21 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.180980 Oct 17 04:32:04.152285 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 67/129] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:03 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:05.176048 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-18d59cf6-07a8-484f-9d72-650dc52f4a5a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:05.176546 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-18d59cf6-07a8-484f-9d72-650dc52f4a5a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:05.185197 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=89 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:32:05.188543 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18d59cf6-07a8-484f-9d72-650dc52f4a5a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:05.190406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18d59cf6-07a8-484f-9d72-650dc52f4a5a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:05.190845 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18d59cf6-07a8-484f-9d72-650dc52f4a5a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:05.192719 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18d59cf6-07a8-484f-9d72-650dc52f4a5a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:05.193908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18d59cf6-07a8-484f-9d72-650dc52f4a5a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:05.196008 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18d59cf6-07a8-484f-9d72-650dc52f4a5a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:05.221236 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:32:05.407060 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-18d59cf6-07a8-484f-9d72-650dc52f4a5a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:05.416643 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-18d59cf6-07a8-484f-9d72-650dc52f4a5a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.244794 Oct 17 04:32:05.417283 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 63/130] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:05 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:06.440829 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-17665a63-4133-49e4-bec8-580230ea9e72 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:06.441511 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-17665a63-4133-49e4-bec8-580230ea9e72 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:06.451566 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17665a63-4133-49e4-bec8-580230ea9e72 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:06.452561 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17665a63-4133-49e4-bec8-580230ea9e72 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:06.453099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17665a63-4133-49e4-bec8-580230ea9e72 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:06.453874 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17665a63-4133-49e4-bec8-580230ea9e72 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:06.454445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17665a63-4133-49e4-bec8-580230ea9e72 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:06.454930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17665a63-4133-49e4-bec8-580230ea9e72 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:06.695492 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-17665a63-4133-49e4-bec8-580230ea9e72 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:06.698452 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-609802eb-3827-4884-afd0-08eac06e690f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:06.699897 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-609802eb-3827-4884-afd0-08eac06e690f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:06.707640 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-17665a63-4133-49e4-bec8-580230ea9e72 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.271549 Oct 17 04:32:06.708639 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-609802eb-3827-4884-afd0-08eac06e690f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:06.709988 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-609802eb-3827-4884-afd0-08eac06e690f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:06.710590 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-609802eb-3827-4884-afd0-08eac06e690f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:06.711562 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-609802eb-3827-4884-afd0-08eac06e690f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:06.712174 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-609802eb-3827-4884-afd0-08eac06e690f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:06.712788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-609802eb-3827-4884-afd0-08eac06e690f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:06.722697 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 68/131] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:06 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:06.748645 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-609802eb-3827-4884-afd0-08eac06e690f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:32:06.954647 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-609802eb-3827-4884-afd0-08eac06e690f tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "DELETE /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 204 len: 0 microversion: 2.1 time: 0.265099 Oct 17 04:32:06.956726 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 64/132] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:32:06 2022] DELETE /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 04:32:06.967296 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ad35d7b1-3e6d-4a98-b55a-59db76bff0d0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:06.968641 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ad35d7b1-3e6d-4a98-b55a-59db76bff0d0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:06.982115 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad35d7b1-3e6d-4a98-b55a-59db76bff0d0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:06.985670 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad35d7b1-3e6d-4a98-b55a-59db76bff0d0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:06.986233 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad35d7b1-3e6d-4a98-b55a-59db76bff0d0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:06.988078 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad35d7b1-3e6d-4a98-b55a-59db76bff0d0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:06.988798 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad35d7b1-3e6d-4a98-b55a-59db76bff0d0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:06.990184 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad35d7b1-3e6d-4a98-b55a-59db76bff0d0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:07.293392 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-ad35d7b1-3e6d-4a98-b55a-59db76bff0d0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:07.313409 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ad35d7b1-3e6d-4a98-b55a-59db76bff0d0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1554 microversion: 2.1 time: 0.348515 Oct 17 04:32:07.314503 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 69/133] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:06 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1554 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:07.737379 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9dc94256-3de5-4f75-88a0-4fb4b5b95496 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:07.738903 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9dc94256-3de5-4f75-88a0-4fb4b5b95496 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:07.745699 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9dc94256-3de5-4f75-88a0-4fb4b5b95496 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:07.746875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9dc94256-3de5-4f75-88a0-4fb4b5b95496 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:07.747323 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9dc94256-3de5-4f75-88a0-4fb4b5b95496 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:07.748445 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9dc94256-3de5-4f75-88a0-4fb4b5b95496 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:07.748930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9dc94256-3de5-4f75-88a0-4fb4b5b95496 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:07.749372 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9dc94256-3de5-4f75-88a0-4fb4b5b95496 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:07.926716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-9dc94256-3de5-4f75-88a0-4fb4b5b95496 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:07.934719 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9dc94256-3de5-4f75-88a0-4fb4b5b95496 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.205007 Oct 17 04:32:07.936106 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 65/134] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:07 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:08.345325 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7e196c13-f41f-4f22-acb0-1768dd597580 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:08.346040 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7e196c13-f41f-4f22-acb0-1768dd597580 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:08.355516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e196c13-f41f-4f22-acb0-1768dd597580 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:08.356230 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e196c13-f41f-4f22-acb0-1768dd597580 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:08.356735 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e196c13-f41f-4f22-acb0-1768dd597580 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:08.357647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e196c13-f41f-4f22-acb0-1768dd597580 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:08.358097 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e196c13-f41f-4f22-acb0-1768dd597580 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:08.358515 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7e196c13-f41f-4f22-acb0-1768dd597580 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:08.536485 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-7e196c13-f41f-4f22-acb0-1768dd597580 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:08.546720 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7e196c13-f41f-4f22-acb0-1768dd597580 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1554 microversion: 2.1 time: 0.205364 Oct 17 04:32:08.547870 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 70/135] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:08 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1554 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:08.957022 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cb91bde1-a362-48ef-92b1-f61115869921 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:08.957861 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cb91bde1-a362-48ef-92b1-f61115869921 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:08.963939 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb91bde1-a362-48ef-92b1-f61115869921 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:08.964713 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb91bde1-a362-48ef-92b1-f61115869921 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:08.964959 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb91bde1-a362-48ef-92b1-f61115869921 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:08.965689 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb91bde1-a362-48ef-92b1-f61115869921 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:08.966147 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb91bde1-a362-48ef-92b1-f61115869921 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:08.966574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cb91bde1-a362-48ef-92b1-f61115869921 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:09.098554 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-cb91bde1-a362-48ef-92b1-f61115869921 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:09.107556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cb91bde1-a362-48ef-92b1-f61115869921 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.154286 Oct 17 04:32:09.108138 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 66/136] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:08 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:09.574963 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2cad00f8-3818-4d51-9075-7bb61dbebed8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:09.575577 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2cad00f8-3818-4d51-9075-7bb61dbebed8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:09.582376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2cad00f8-3818-4d51-9075-7bb61dbebed8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:09.582856 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2cad00f8-3818-4d51-9075-7bb61dbebed8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:09.583314 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2cad00f8-3818-4d51-9075-7bb61dbebed8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:09.584003 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2cad00f8-3818-4d51-9075-7bb61dbebed8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:09.584456 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2cad00f8-3818-4d51-9075-7bb61dbebed8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:09.584875 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2cad00f8-3818-4d51-9075-7bb61dbebed8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:09.742911 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-2cad00f8-3818-4d51-9075-7bb61dbebed8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:09.753694 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2cad00f8-3818-4d51-9075-7bb61dbebed8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1554 microversion: 2.1 time: 0.182287 Oct 17 04:32:09.754744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 71/137] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:09 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:10.132219 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b9f7abf3-7c0f-4b37-85e4-3c97f929db4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:10.132901 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b9f7abf3-7c0f-4b37-85e4-3c97f929db4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:10.139690 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9f7abf3-7c0f-4b37-85e4-3c97f929db4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:10.140178 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9f7abf3-7c0f-4b37-85e4-3c97f929db4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:10.140618 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9f7abf3-7c0f-4b37-85e4-3c97f929db4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:10.141343 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9f7abf3-7c0f-4b37-85e4-3c97f929db4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:10.141861 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9f7abf3-7c0f-4b37-85e4-3c97f929db4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:10.142456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9f7abf3-7c0f-4b37-85e4-3c97f929db4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:10.293441 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-b9f7abf3-7c0f-4b37-85e4-3c97f929db4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:10.312946 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b9f7abf3-7c0f-4b37-85e4-3c97f929db4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.184732 Oct 17 04:32:10.314086 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 67/138] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:10 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:10.778509 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-45dea7da-3283-4896-bfd2-b608ae65abc8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:10.779031 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-45dea7da-3283-4896-bfd2-b608ae65abc8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:10.785476 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45dea7da-3283-4896-bfd2-b608ae65abc8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:10.785951 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45dea7da-3283-4896-bfd2-b608ae65abc8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:10.786396 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45dea7da-3283-4896-bfd2-b608ae65abc8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:10.787103 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45dea7da-3283-4896-bfd2-b608ae65abc8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:10.787589 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45dea7da-3283-4896-bfd2-b608ae65abc8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:10.788008 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45dea7da-3283-4896-bfd2-b608ae65abc8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:10.925908 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-45dea7da-3283-4896-bfd2-b608ae65abc8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:10.929318 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:32:10.935098 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-45dea7da-3283-4896-bfd2-b608ae65abc8 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1554 microversion: 2.1 time: 0.161225 Oct 17 04:32:10.935978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 72/139] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:10 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:11.340814 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9ae540f6-e776-4e48-b6d5-c75d15508d39 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:11.341606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9ae540f6-e776-4e48-b6d5-c75d15508d39 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:11.348967 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ae540f6-e776-4e48-b6d5-c75d15508d39 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:11.349482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ae540f6-e776-4e48-b6d5-c75d15508d39 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:11.349937 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ae540f6-e776-4e48-b6d5-c75d15508d39 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:11.350767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ae540f6-e776-4e48-b6d5-c75d15508d39 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:11.351211 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ae540f6-e776-4e48-b6d5-c75d15508d39 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:11.351828 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ae540f6-e776-4e48-b6d5-c75d15508d39 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:11.704238 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-f72ee8a5-6c38-4d5a-98a0-c966a27b021f req-c6737b8d-0923-41dd-a0a2-844c8ee0024e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c34166-9c02-41cb-b5e6-21cc7c4b06b7", "name": "network-vif-deleted", "tag": "62afe409-bc34-457e-bcb8-6b6ebb859ed6"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:32:11.716331 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-9ae540f6-e776-4e48-b6d5-c75d15508d39 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:11.724278 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f72ee8a5-6c38-4d5a-98a0-c966a27b021f req-c6737b8d-0923-41dd-a0a2-844c8ee0024e service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:11.725988 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f72ee8a5-6c38-4d5a-98a0-c966a27b021f req-c6737b8d-0923-41dd-a0a2-844c8ee0024e service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:11.726574 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f72ee8a5-6c38-4d5a-98a0-c966a27b021f req-c6737b8d-0923-41dd-a0a2-844c8ee0024e service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:11.727650 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9ae540f6-e776-4e48-b6d5-c75d15508d39 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.391536 Oct 17 04:32:11.737943 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 68/140] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:11 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:11.752706 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-f72ee8a5-6c38-4d5a-98a0-c966a27b021f req-c6737b8d-0923-41dd-a0a2-844c8ee0024e service nova] Creating event network-vif-deleted:62afe409-bc34-457e-bcb8-6b6ebb859ed6 for instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 on hv-cinder-86155 Oct 17 04:32:11.759465 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-f72ee8a5-6c38-4d5a-98a0-c966a27b021f req-c6737b8d-0923-41dd-a0a2-844c8ee0024e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064039 Oct 17 04:32:11.761840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 73/141] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:32:11.958815 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6362e31e-c62d-4b63-9bc1-f80dc77288f7 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:11.959422 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6362e31e-c62d-4b63-9bc1-f80dc77288f7 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:11.965431 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6362e31e-c62d-4b63-9bc1-f80dc77288f7 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:11.965909 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6362e31e-c62d-4b63-9bc1-f80dc77288f7 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:11.966378 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6362e31e-c62d-4b63-9bc1-f80dc77288f7 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:11.967062 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6362e31e-c62d-4b63-9bc1-f80dc77288f7 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:11.967518 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6362e31e-c62d-4b63-9bc1-f80dc77288f7 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:11.967935 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6362e31e-c62d-4b63-9bc1-f80dc77288f7 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:12.029303 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-6362e31e-c62d-4b63-9bc1-f80dc77288f7 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:12.037777 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6362e31e-c62d-4b63-9bc1-f80dc77288f7 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1346 microversion: 2.1 time: 0.082831 Oct 17 04:32:12.038470 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 69/142] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:11 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:12.757275 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a5a02a73-8e37-4dca-97e8-d115c617e712 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:12.757979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a5a02a73-8e37-4dca-97e8-d115c617e712 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:12.764909 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5a02a73-8e37-4dca-97e8-d115c617e712 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:12.765445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5a02a73-8e37-4dca-97e8-d115c617e712 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:12.765879 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5a02a73-8e37-4dca-97e8-d115c617e712 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:12.766568 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5a02a73-8e37-4dca-97e8-d115c617e712 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:12.768044 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5a02a73-8e37-4dca-97e8-d115c617e712 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:12.768510 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a5a02a73-8e37-4dca-97e8-d115c617e712 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:12.934603 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a5a02a73-8e37-4dca-97e8-d115c617e712 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:12.943084 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a5a02a73-8e37-4dca-97e8-d115c617e712 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.190667 Oct 17 04:32:12.945129 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 74/143] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:12 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:32:13.062947 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-abd6102b-ebce-4ebe-9824-d6313e554537 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:13.064670 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-abd6102b-ebce-4ebe-9824-d6313e554537 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:13.074631 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-abd6102b-ebce-4ebe-9824-d6313e554537 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:13.080203 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-abd6102b-ebce-4ebe-9824-d6313e554537 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:13.081860 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-abd6102b-ebce-4ebe-9824-d6313e554537 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:13.083373 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-abd6102b-ebce-4ebe-9824-d6313e554537 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:13.083860 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-abd6102b-ebce-4ebe-9824-d6313e554537 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:13.084475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-abd6102b-ebce-4ebe-9824-d6313e554537 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:13.125641 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-abd6102b-ebce-4ebe-9824-d6313e554537 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:13.126380 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-abd6102b-ebce-4ebe-9824-d6313e554537 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:13.127683 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-abd6102b-ebce-4ebe-9824-d6313e554537 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:13.128154 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-abd6102b-ebce-4ebe-9824-d6313e554537 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lazy-loading 'fault' on Instance uuid 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:32:13.210202 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-abd6102b-ebce-4ebe-9824-d6313e554537 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34187140ebf44707a37b082b4d5676eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb02a1b40e4b83bc6baf4c3ac1bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:13.220190 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-abd6102b-ebce-4ebe-9824-d6313e554537 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 200 len: 1351 microversion: 2.1 time: 0.162659 Oct 17 04:32:13.221017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 70/144] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:13 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 1351 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:13.967914 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b4591868-a934-42f0-b37b-65a1a76607a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:13.968522 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b4591868-a934-42f0-b37b-65a1a76607a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:13.975058 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4591868-a934-42f0-b37b-65a1a76607a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:13.975610 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4591868-a934-42f0-b37b-65a1a76607a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:13.976111 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4591868-a934-42f0-b37b-65a1a76607a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:13.976890 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4591868-a934-42f0-b37b-65a1a76607a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:13.977436 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4591868-a934-42f0-b37b-65a1a76607a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:13.977922 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b4591868-a934-42f0-b37b-65a1a76607a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:14.115088 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b4591868-a934-42f0-b37b-65a1a76607a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:14.123035 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b4591868-a934-42f0-b37b-65a1a76607a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.159511 Oct 17 04:32:14.123616 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 75/145] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:13 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:14.243872 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-867a5e84-083b-4da0-8432-07ce78812377 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:14.244585 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-867a5e84-083b-4da0-8432-07ce78812377 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:14.250721 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-867a5e84-083b-4da0-8432-07ce78812377 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:14.251280 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-867a5e84-083b-4da0-8432-07ce78812377 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:14.251804 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-867a5e84-083b-4da0-8432-07ce78812377 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:14.252633 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-867a5e84-083b-4da0-8432-07ce78812377 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:14.253179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-867a5e84-083b-4da0-8432-07ce78812377 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:14.253668 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-867a5e84-083b-4da0-8432-07ce78812377 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:14.269000 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-867a5e84-083b-4da0-8432-07ce78812377 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] HTTP exception thrown: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-867a5e84-083b-4da0-8432-07ce78812377 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Request method failure captured: Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 HTTP/1.1 Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNqN7nbmImiIC32ShO0xp-JerVtfUi0Ff8n71HdLpzElQw01YcUO9i4TRqGE3tcHvXx7e27jZ2BRjauY9RoxKtCT3MUEF9v7mcjyxnpOcKPYLpgJuLF9UmOEfGJI4OtZXIXqbtUWQkNldRxEhT5ORjFpf1zVvt5EsV-uO-1OEG26ypk Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: e5eb02a1b40e4b83bc6baf4c3ac1bbbf Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-DeleteServersTestJSON-1445104658 Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:32:14.274419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:32:14.276019 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5eb02a1b40e4b83bc6baf4c3ac1bbbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e5eb02a1b40e4b83bc6baf4c3ac1bbbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e5eb02a1b40e4b83bc6baf4c3ac1bbbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5eb02a1b40e4b83bc6baf4c3ac1bbbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:32:14.276019 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-DeleteServersTestJSON-1445104658 Oct 17 04:32:14.276019 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: e5eb02a1b40e4b83bc6baf4c3ac1bbbf Oct 17 04:32:14.276019 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-DeleteServersTestJSON-1445104658 Oct 17 04:32:14.276019 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-DeleteServersTestJSON-1445104658-project Oct 17 04:32:14.276019 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:32:14.276019 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:32:14.276019 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: 34187140ebf44707a37b082b4d5676eb Oct 17 04:32:14.276019 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-DeleteServersTestJSON-1445104658-project Oct 17 04:32:14.276019 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:32:14.276019 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:14.276019 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': '75c34166-9c02-41cb-b5e6-21cc7c4b06b7'} Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:32:14.277550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:32:14.278906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:32:14.278906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:32:14.278906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:32:14.278906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:32:14.278906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:32:14.278906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:32:14.278906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:32:14.278906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:14.278906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:32:14.278906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:32:14.278906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:32:14.278906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:14.278906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:32:14.278906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:32:14.278906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:32:14.278906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:32:14.278906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:14.278906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:32:14.280300 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-867a5e84-083b-4da0-8432-07ce78812377 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Returning 404 to user: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:32:14.280300 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-867a5e84-083b-4da0-8432-07ce78812377 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 404 len: 111 microversion: 2.1 time: 0.035984 Oct 17 04:32:14.280777 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 71/146] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:14 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:32:14.412901 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-863302a1-fc69-45fc-9b9d-c01496a7f21d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:14.415200 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-863302a1-fc69-45fc-9b9d-c01496a7f21d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:14.422563 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-863302a1-fc69-45fc-9b9d-c01496a7f21d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:14.423142 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-863302a1-fc69-45fc-9b9d-c01496a7f21d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:14.423650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-863302a1-fc69-45fc-9b9d-c01496a7f21d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:14.424497 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-863302a1-fc69-45fc-9b9d-c01496a7f21d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:14.425139 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-863302a1-fc69-45fc-9b9d-c01496a7f21d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:14.425701 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-863302a1-fc69-45fc-9b9d-c01496a7f21d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:14.440260 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-863302a1-fc69-45fc-9b9d-c01496a7f21d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] HTTP exception thrown: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-863302a1-fc69-45fc-9b9d-c01496a7f21d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Request method failure captured: Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7/os-volume_attachments HTTP/1.1 Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNqN7nbmImiIC32ShO0xp-JerVtfUi0Ff8n71HdLpzElQw01YcUO9i4TRqGE3tcHvXx7e27jZ2BRjauY9RoxKtCT3MUEF9v7mcjyxnpOcKPYLpgJuLF9UmOEfGJI4OtZXIXqbtUWQkNldRxEhT5ORjFpf1zVvt5EsV-uO-1OEG26ypk Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: e5eb02a1b40e4b83bc6baf4c3ac1bbbf Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersTestJSON-1445104658 Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:32:14.446926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:32:14.449123 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5eb02a1b40e4b83bc6baf4c3ac1bbbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e5eb02a1b40e4b83bc6baf4c3ac1bbbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e5eb02a1b40e4b83bc6baf4c3ac1bbbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5eb02a1b40e4b83bc6baf4c3ac1bbbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:32:14.449123 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersTestJSON-1445104658 Oct 17 04:32:14.449123 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: e5eb02a1b40e4b83bc6baf4c3ac1bbbf Oct 17 04:32:14.449123 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersTestJSON-1445104658 Oct 17 04:32:14.449123 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-DeleteServersTestJSON-1445104658-project Oct 17 04:32:14.449123 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:32:14.449123 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:32:14.449123 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 34187140ebf44707a37b082b4d5676eb Oct 17 04:32:14.449123 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersTestJSON-1445104658-project Oct 17 04:32:14.449123 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:32:14.449123 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:14.449123 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'server_id': '75c34166-9c02-41cb-b5e6-21cc7c4b06b7'} Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:32:14.453371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:14.454632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:14.456056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-863302a1-fc69-45fc-9b9d-c01496a7f21d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Returning 404 to user: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:32:14.456056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-863302a1-fc69-45fc-9b9d-c01496a7f21d tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041059 Oct 17 04:32:14.456056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 76/147] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:32:14 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:32:15.147211 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4d206d18-1605-4356-9f28-a25ee6d4d3be tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:15.147846 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4d206d18-1605-4356-9f28-a25ee6d4d3be tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:15.154791 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d206d18-1605-4356-9f28-a25ee6d4d3be tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:15.155281 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d206d18-1605-4356-9f28-a25ee6d4d3be tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:15.155731 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d206d18-1605-4356-9f28-a25ee6d4d3be tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:15.156436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d206d18-1605-4356-9f28-a25ee6d4d3be tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:15.156899 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d206d18-1605-4356-9f28-a25ee6d4d3be tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:15.157343 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4d206d18-1605-4356-9f28-a25ee6d4d3be tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:15.307120 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-4d206d18-1605-4356-9f28-a25ee6d4d3be tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:15.315642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4d206d18-1605-4356-9f28-a25ee6d4d3be tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.172323 Oct 17 04:32:15.316208 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 72/148] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:15 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:15.665431 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3bfb150b-3658-40b1-a3b8-f8e8d3cac208 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:15.665993 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3bfb150b-3658-40b1-a3b8-f8e8d3cac208 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:15.673560 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bfb150b-3658-40b1-a3b8-f8e8d3cac208 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:15.674055 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bfb150b-3658-40b1-a3b8-f8e8d3cac208 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:15.674495 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bfb150b-3658-40b1-a3b8-f8e8d3cac208 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:15.675192 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bfb150b-3658-40b1-a3b8-f8e8d3cac208 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:15.675652 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bfb150b-3658-40b1-a3b8-f8e8d3cac208 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:15.676076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bfb150b-3658-40b1-a3b8-f8e8d3cac208 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:15.691052 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-3bfb150b-3658-40b1-a3b8-f8e8d3cac208 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] HTTP exception thrown: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3bfb150b-3658-40b1-a3b8-f8e8d3cac208 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Request method failure captured: Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 HTTP/1.1 Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNqN7nbmImiIC32ShO0xp-JerVtfUi0Ff8n71HdLpzElQw01YcUO9i4TRqGE3tcHvXx7e27jZ2BRjauY9RoxKtCT3MUEF9v7mcjyxnpOcKPYLpgJuLF9UmOEfGJI4OtZXIXqbtUWQkNldRxEhT5ORjFpf1zVvt5EsV-uO-1OEG26ypk Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: e5eb02a1b40e4b83bc6baf4c3ac1bbbf Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-DeleteServersTestJSON-1445104658 Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:32:15.693620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:32:15.695065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5eb02a1b40e4b83bc6baf4c3ac1bbbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e5eb02a1b40e4b83bc6baf4c3ac1bbbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e5eb02a1b40e4b83bc6baf4c3ac1bbbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5eb02a1b40e4b83bc6baf4c3ac1bbbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:32:15.695065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-DeleteServersTestJSON-1445104658 Oct 17 04:32:15.695065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: e5eb02a1b40e4b83bc6baf4c3ac1bbbf Oct 17 04:32:15.695065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-DeleteServersTestJSON-1445104658 Oct 17 04:32:15.695065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-DeleteServersTestJSON-1445104658-project Oct 17 04:32:15.695065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:32:15.695065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:32:15.695065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 34187140ebf44707a37b082b4d5676eb Oct 17 04:32:15.695065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-DeleteServersTestJSON-1445104658-project Oct 17 04:32:15.695065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:32:15.695065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:15.695065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': '75c34166-9c02-41cb-b5e6-21cc7c4b06b7'} Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:32:15.695840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:15.697116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:15.700247 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3bfb150b-3658-40b1-a3b8-f8e8d3cac208 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Returning 404 to user: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:32:15.701289 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3bfb150b-3658-40b1-a3b8-f8e8d3cac208 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "DELETE /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 404 len: 111 microversion: 2.1 time: 0.039924 Oct 17 04:32:15.702271 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 77/149] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:32:15 2022] DELETE /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:32:15.711208 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0c17fc83-70b3-4d33-bb18-a351df2845b0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:15.712556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0c17fc83-70b3-4d33-bb18-a351df2845b0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] [instance: 75c34166-9c02-41cb-b5e6-21cc7c4b06b7] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:15.719760 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c17fc83-70b3-4d33-bb18-a351df2845b0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:15.720488 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c17fc83-70b3-4d33-bb18-a351df2845b0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:15.721034 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c17fc83-70b3-4d33-bb18-a351df2845b0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:15.725174 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c17fc83-70b3-4d33-bb18-a351df2845b0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:15.725952 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c17fc83-70b3-4d33-bb18-a351df2845b0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:15.726611 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0c17fc83-70b3-4d33-bb18-a351df2845b0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:15.741021 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-0c17fc83-70b3-4d33-bb18-a351df2845b0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] HTTP exception thrown: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0c17fc83-70b3-4d33-bb18-a351df2845b0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Request method failure captured: Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 HTTP/1.1 Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNqN7nbmImiIC32ShO0xp-JerVtfUi0Ff8n71HdLpzElQw01YcUO9i4TRqGE3tcHvXx7e27jZ2BRjauY9RoxKtCT3MUEF9v7mcjyxnpOcKPYLpgJuLF9UmOEfGJI4OtZXIXqbtUWQkNldRxEhT5ORjFpf1zVvt5EsV-uO-1OEG26ypk Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: e5eb02a1b40e4b83bc6baf4c3ac1bbbf Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-DeleteServersTestJSON-1445104658 Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:32:15.742574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:32:15.743934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5eb02a1b40e4b83bc6baf4c3ac1bbbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e5eb02a1b40e4b83bc6baf4c3ac1bbbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e5eb02a1b40e4b83bc6baf4c3ac1bbbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5eb02a1b40e4b83bc6baf4c3ac1bbbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:32:15.743934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-DeleteServersTestJSON-1445104658 Oct 17 04:32:15.743934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: e5eb02a1b40e4b83bc6baf4c3ac1bbbf Oct 17 04:32:15.743934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-DeleteServersTestJSON-1445104658 Oct 17 04:32:15.743934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-DeleteServersTestJSON-1445104658-project Oct 17 04:32:15.743934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:32:15.743934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:32:15.743934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: 34187140ebf44707a37b082b4d5676eb Oct 17 04:32:15.743934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-DeleteServersTestJSON-1445104658-project Oct 17 04:32:15.743934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:32:15.743934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:15.743934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': '75c34166-9c02-41cb-b5e6-21cc7c4b06b7'} Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:32:15.744606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:32:15.745716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:32:15.745716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:32:15.745716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:32:15.745716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:32:15.745716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:32:15.745716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:32:15.745716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:32:15.745716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:15.745716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:32:15.745716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:32:15.745716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:32:15.745716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:15.745716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:32:15.745716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:32:15.745716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:32:15.745716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:32:15.745716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. Oct 17 04:32:15.745716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:32:15.746667 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0c17fc83-70b3-4d33-bb18-a351df2845b0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] Returning 404 to user: Instance 75c34166-9c02-41cb-b5e6-21cc7c4b06b7 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:32:15.746667 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0c17fc83-70b3-4d33-bb18-a351df2845b0 tempest-DeleteServersTestJSON-1445104658 tempest-DeleteServersTestJSON-1445104658-project] 10.222.0.40 "GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7" status: 404 len: 111 microversion: 2.1 time: 0.037624 Oct 17 04:32:15.746667 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 73/150] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:15 2022] GET /compute/v2.1/servers/75c34166-9c02-41cb-b5e6-21cc7c4b06b7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 04:32:16.339488 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0be064a4-2cd2-4878-b46f-24f3fb72db84 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:16.340209 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0be064a4-2cd2-4878-b46f-24f3fb72db84 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:16.346832 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0be064a4-2cd2-4878-b46f-24f3fb72db84 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:16.347681 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0be064a4-2cd2-4878-b46f-24f3fb72db84 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:16.348297 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0be064a4-2cd2-4878-b46f-24f3fb72db84 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:16.349222 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0be064a4-2cd2-4878-b46f-24f3fb72db84 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:16.349834 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0be064a4-2cd2-4878-b46f-24f3fb72db84 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:16.350419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0be064a4-2cd2-4878-b46f-24f3fb72db84 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:16.571946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-0be064a4-2cd2-4878-b46f-24f3fb72db84 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:16.580879 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0be064a4-2cd2-4878-b46f-24f3fb72db84 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.245513 Oct 17 04:32:16.584377 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 78/151] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:16 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:17.603712 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fb5f9c05-e752-47ed-a788-c1434d67e1a1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:17.606405 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fb5f9c05-e752-47ed-a788-c1434d67e1a1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:17.614484 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb5f9c05-e752-47ed-a788-c1434d67e1a1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:17.615358 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb5f9c05-e752-47ed-a788-c1434d67e1a1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:17.615805 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb5f9c05-e752-47ed-a788-c1434d67e1a1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:17.617432 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb5f9c05-e752-47ed-a788-c1434d67e1a1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:17.618060 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb5f9c05-e752-47ed-a788-c1434d67e1a1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:17.618632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fb5f9c05-e752-47ed-a788-c1434d67e1a1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:17.829175 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-fb5f9c05-e752-47ed-a788-c1434d67e1a1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:17.844855 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fb5f9c05-e752-47ed-a788-c1434d67e1a1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.244704 Oct 17 04:32:17.845513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 74/152] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:17 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:18.879534 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f9f173e4-c8c7-4e72-b04a-fac6956d4037 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:18.884242 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f9f173e4-c8c7-4e72-b04a-fac6956d4037 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:18.907420 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9f173e4-c8c7-4e72-b04a-fac6956d4037 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:18.908061 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9f173e4-c8c7-4e72-b04a-fac6956d4037 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:18.908926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9f173e4-c8c7-4e72-b04a-fac6956d4037 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:18.910588 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9f173e4-c8c7-4e72-b04a-fac6956d4037 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:18.911050 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9f173e4-c8c7-4e72-b04a-fac6956d4037 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:18.911479 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9f173e4-c8c7-4e72-b04a-fac6956d4037 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:19.090555 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f9f173e4-c8c7-4e72-b04a-fac6956d4037 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:19.098749 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f9f173e4-c8c7-4e72-b04a-fac6956d4037 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.230761 Oct 17 04:32:19.099339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 79/153] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:18 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:19.645267 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ecd4e8c5-4441-414c-ad4c-13f35cef584f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-847035525", "imageRef": "bf655d8c-fb2f-42ef-a7a7-0386f57b58cf", "flavorRef": "452", "networks": [{"uuid": "41cde4c2-319c-405f-953d-34a4f0f9247a"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:32:19.716049 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-ecd4e8c5-4441-414c-ad4c-13f35cef584f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] validate_networks() for [('41cde4c2-319c-405f-953d-34a4f0f9247a', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:32:20.123165 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-86f7a49f-c5ef-4be6-b464-88e763bde930 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:20.124602 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-86f7a49f-c5ef-4be6-b464-88e763bde930 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:20.132444 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86f7a49f-c5ef-4be6-b464-88e763bde930 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:20.133101 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86f7a49f-c5ef-4be6-b464-88e763bde930 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:20.133806 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86f7a49f-c5ef-4be6-b464-88e763bde930 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:20.134673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86f7a49f-c5ef-4be6-b464-88e763bde930 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:20.135290 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86f7a49f-c5ef-4be6-b464-88e763bde930 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:20.136980 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-86f7a49f-c5ef-4be6-b464-88e763bde930 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:20.531455 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-86f7a49f-c5ef-4be6-b464-88e763bde930 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:20.544092 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-86f7a49f-c5ef-4be6-b464-88e763bde930 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.425660 Oct 17 04:32:20.546574 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 80/154] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:20 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:32:20.673399 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ecd4e8c5-4441-414c-ad4c-13f35cef584f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:32:20.673880 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ecd4e8c5-4441-414c-ad4c-13f35cef584f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:32:20.674268 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ecd4e8c5-4441-414c-ad4c-13f35cef584f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:32:20.674830 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ecd4e8c5-4441-414c-ad4c-13f35cef584f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:32:20.675242 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-ecd4e8c5-4441-414c-ad4c-13f35cef584f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:32:20.686855 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecd4e8c5-4441-414c-ad4c-13f35cef584f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:20.687500 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecd4e8c5-4441-414c-ad4c-13f35cef584f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:20.687951 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecd4e8c5-4441-414c-ad4c-13f35cef584f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:20.688749 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecd4e8c5-4441-414c-ad4c-13f35cef584f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:20.701421 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecd4e8c5-4441-414c-ad4c-13f35cef584f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:20.702222 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ecd4e8c5-4441-414c-ad4c-13f35cef584f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:20.741359 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-ecd4e8c5-4441-414c-ad4c-13f35cef584f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Getting quotas for project 34d5aaa16da54ea19e9c982c50540377. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:32:20.753561 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-ecd4e8c5-4441-414c-ad4c-13f35cef584f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Getting quotas for user 3fb7bee3a97e4312ba30451b4a5f980d and project 34d5aaa16da54ea19e9c982c50540377. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:32:20.766901 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ecd4e8c5-4441-414c-ad4c-13f35cef584f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:32:20.769348 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ecd4e8c5-4441-414c-ad4c-13f35cef584f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf655d8c-fb2f-42ef-a7a7-0386f57b58cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:32:20.817405 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ecd4e8c5-4441-414c-ad4c-13f35cef584f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.179012 Oct 17 04:32:20.818261 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 75/155] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:32:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 04:32:20.830093 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ea6f7570-ac5c-4a9c-a18d-277cdf09cbb9 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:20.830698 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ea6f7570-ac5c-4a9c-a18d-277cdf09cbb9 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:20.920088 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-ea6f7570-ac5c-4a9c-a18d-277cdf09cbb9 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:20.942620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ea6f7570-ac5c-4a9c-a18d-277cdf09cbb9 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1213 microversion: 2.1 time: 0.116335 Oct 17 04:32:20.944435 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 81/156] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:20 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:21.568787 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4a80ff00-e228-48e5-8069-03950a77d1e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:21.569533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4a80ff00-e228-48e5-8069-03950a77d1e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:21.580220 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a80ff00-e228-48e5-8069-03950a77d1e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:21.581176 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a80ff00-e228-48e5-8069-03950a77d1e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:21.581802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a80ff00-e228-48e5-8069-03950a77d1e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:21.583087 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a80ff00-e228-48e5-8069-03950a77d1e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:21.583816 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a80ff00-e228-48e5-8069-03950a77d1e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:21.584394 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a80ff00-e228-48e5-8069-03950a77d1e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:21.740613 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-4a80ff00-e228-48e5-8069-03950a77d1e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:21.750663 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4a80ff00-e228-48e5-8069-03950a77d1e3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1521 microversion: 2.1 time: 0.186169 Oct 17 04:32:21.751235 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 76/157] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:21 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:21.884895 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7a04e2bb-722b-489a-a33e-20502bb302be tempest-VolumesGetTestJSON-360760555 tempest-VolumesGetTestJSON-360760555-project] Action: 'create', calling method: .version_select at 0x7fc631093f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1368036880", "metadata": {"Type": "work"}}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:32:21.967080 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-04407ac2-b53e-4b57-9e1c-c73889052637 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:21.967489 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-04407ac2-b53e-4b57-9e1c-c73889052637 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:21.974181 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-04407ac2-b53e-4b57-9e1c-c73889052637 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:21.974850 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-04407ac2-b53e-4b57-9e1c-c73889052637 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:21.975605 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-04407ac2-b53e-4b57-9e1c-c73889052637 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:21.976303 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-04407ac2-b53e-4b57-9e1c-c73889052637 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:21.977120 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-04407ac2-b53e-4b57-9e1c-c73889052637 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:21.977693 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-04407ac2-b53e-4b57-9e1c-c73889052637 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:22.050775 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-04407ac2-b53e-4b57-9e1c-c73889052637 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:22.061605 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-04407ac2-b53e-4b57-9e1c-c73889052637 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1209 microversion: 2.1 time: 0.098544 Oct 17 04:32:22.062499 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 77/158] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:21 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:32:22.215227 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7a04e2bb-722b-489a-a33e-20502bb302be tempest-VolumesGetTestJSON-360760555 tempest-VolumesGetTestJSON-360760555-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.449805 Oct 17 04:32:22.215861 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 82/159] 10.222.0.40 () {60 vars in 1156 bytes} [Mon Oct 17 04:32:21 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 451 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 17 04:32:22.233363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b2ba16f5-523f-4cd3-b821-6589d8d70619 tempest-VolumesGetTestJSON-360760555 tempest-VolumesGetTestJSON-360760555-project] Calling method '.version_select at 0x7fc63102ea60>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:22.308883 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b2ba16f5-523f-4cd3-b821-6589d8d70619 tempest-VolumesGetTestJSON-360760555 tempest-VolumesGetTestJSON-360760555-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/64016029-a55f-4a75-b091-4fa191b1332c" status: 200 len: 353 microversion: 2.1 time: 0.083913 Oct 17 04:32:22.309500 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 78/160] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Oct 17 04:32:22 2022] GET /compute/v2.1/os-volumes/64016029-a55f-4a75-b091-4fa191b1332c => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:32:22.774285 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-307d33c8-5ae4-4cbf-9aae-dbe48f737b4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:22.775026 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-307d33c8-5ae4-4cbf-9aae-dbe48f737b4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:22.782504 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-307d33c8-5ae4-4cbf-9aae-dbe48f737b4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:22.783153 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-307d33c8-5ae4-4cbf-9aae-dbe48f737b4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:22.783776 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-307d33c8-5ae4-4cbf-9aae-dbe48f737b4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:22.784772 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-307d33c8-5ae4-4cbf-9aae-dbe48f737b4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:22.785423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-307d33c8-5ae4-4cbf-9aae-dbe48f737b4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:22.785853 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-307d33c8-5ae4-4cbf-9aae-dbe48f737b4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:23.029991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-307d33c8-5ae4-4cbf-9aae-dbe48f737b4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:23.045403 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-307d33c8-5ae4-4cbf-9aae-dbe48f737b4d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1501 microversion: 2.1 time: 0.274162 Oct 17 04:32:23.046015 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 83/161] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:22 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1501 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:23.068732 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f14270db-5f46-4cf4-baee-0964c4a7801a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:23.069381 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f14270db-5f46-4cf4-baee-0964c4a7801a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:23.076636 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f14270db-5f46-4cf4-baee-0964c4a7801a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:23.077405 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f14270db-5f46-4cf4-baee-0964c4a7801a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:23.078261 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f14270db-5f46-4cf4-baee-0964c4a7801a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:23.083482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f14270db-5f46-4cf4-baee-0964c4a7801a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:23.084168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f14270db-5f46-4cf4-baee-0964c4a7801a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:23.089751 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4fba4d2a-1e2a-491c-81dc-60903980f1dd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:23.090538 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4fba4d2a-1e2a-491c-81dc-60903980f1dd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:23.095497 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f14270db-5f46-4cf4-baee-0964c4a7801a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:23.096751 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fba4d2a-1e2a-491c-81dc-60903980f1dd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:23.098742 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fba4d2a-1e2a-491c-81dc-60903980f1dd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:23.099357 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fba4d2a-1e2a-491c-81dc-60903980f1dd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:23.100077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fba4d2a-1e2a-491c-81dc-60903980f1dd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:23.100679 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fba4d2a-1e2a-491c-81dc-60903980f1dd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:23.101301 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4fba4d2a-1e2a-491c-81dc-60903980f1dd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:23.223265 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-4fba4d2a-1e2a-491c-81dc-60903980f1dd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:23.232803 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4fba4d2a-1e2a-491c-81dc-60903980f1dd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1271 microversion: 2.1 time: 0.146858 Oct 17 04:32:23.233432 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 84/162] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:23 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1271 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:23.322769 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9d4067fd-e942-4471-9e3f-a5cfce0260ee tempest-VolumesGetTestJSON-360760555 tempest-VolumesGetTestJSON-360760555-project] Calling method '.version_select at 0x7fc631093a60>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:23.350234 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f14270db-5f46-4cf4-baee-0964c4a7801a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:23.361816 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f14270db-5f46-4cf4-baee-0964c4a7801a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1516 microversion: 2.1 time: 0.296743 Oct 17 04:32:23.362682 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 79/163] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:23 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1516 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:23.395797 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9d4067fd-e942-4471-9e3f-a5cfce0260ee tempest-VolumesGetTestJSON-360760555 tempest-VolumesGetTestJSON-360760555-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/64016029-a55f-4a75-b091-4fa191b1332c" status: 200 len: 354 microversion: 2.1 time: 0.076798 Oct 17 04:32:23.396509 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 85/164] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Oct 17 04:32:23 2022] GET /compute/v2.1/os-volumes/64016029-a55f-4a75-b091-4fa191b1332c => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:32:23.411124 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-36c9c4d2-81a1-4492-93f2-ec383b96a8c1 tempest-VolumesGetTestJSON-360760555 tempest-VolumesGetTestJSON-360760555-project] Calling method '.version_select at 0x7fc630ff23a0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:23.498469 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-36c9c4d2-81a1-4492-93f2-ec383b96a8c1 tempest-VolumesGetTestJSON-360760555 tempest-VolumesGetTestJSON-360760555-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/64016029-a55f-4a75-b091-4fa191b1332c" status: 200 len: 354 microversion: 2.1 time: 0.091139 Oct 17 04:32:23.499215 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 80/165] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Oct 17 04:32:23 2022] GET /compute/v2.1/os-volumes/64016029-a55f-4a75-b091-4fa191b1332c => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:32:23.517961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-63e1913f-4ba0-4e41-a167-a312b189e412 tempest-VolumesGetTestJSON-360760555 tempest-VolumesGetTestJSON-360760555-project] Calling method '.version_select at 0x7fc630f801f0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:23.601489 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-63e1913f-4ba0-4e41-a167-a312b189e412 tempest-VolumesGetTestJSON-360760555 tempest-VolumesGetTestJSON-360760555-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/64016029-a55f-4a75-b091-4fa191b1332c" status: 202 len: 0 microversion: 2.1 time: 0.087466 Oct 17 04:32:23.602402 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 86/166] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Oct 17 04:32:23 2022] DELETE /compute/v2.1/os-volumes/64016029-a55f-4a75-b091-4fa191b1332c => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:32:23.611094 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e188f214-c6bf-4dcd-8425-39acde9d5c83 tempest-VolumesGetTestJSON-360760555 tempest-VolumesGetTestJSON-360760555-project] Calling method '.version_select at 0x7fc630ff2310>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:23.665885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e188f214-c6bf-4dcd-8425-39acde9d5c83 tempest-VolumesGetTestJSON-360760555 tempest-VolumesGetTestJSON-360760555-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/64016029-a55f-4a75-b091-4fa191b1332c" status: 200 len: 353 microversion: 2.1 time: 0.058658 Oct 17 04:32:23.666683 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 81/167] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Oct 17 04:32:23 2022] GET /compute/v2.1/os-volumes/64016029-a55f-4a75-b091-4fa191b1332c => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:32:24.258956 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-63039760-7228-4148-95c5-def0e7697d88 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:24.259595 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-63039760-7228-4148-95c5-def0e7697d88 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:24.269360 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63039760-7228-4148-95c5-def0e7697d88 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:24.269860 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63039760-7228-4148-95c5-def0e7697d88 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:24.270299 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63039760-7228-4148-95c5-def0e7697d88 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:24.271006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63039760-7228-4148-95c5-def0e7697d88 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:24.271465 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63039760-7228-4148-95c5-def0e7697d88 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:24.271892 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63039760-7228-4148-95c5-def0e7697d88 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:24.472286 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-63039760-7228-4148-95c5-def0e7697d88 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:24.481968 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-63039760-7228-4148-95c5-def0e7697d88 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1313 microversion: 2.1 time: 0.227369 Oct 17 04:32:24.492141 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 87/168] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:24 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:24.579627 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-cd49bd8d-d6ab-44a6-8dc2-9863f5d18bde req-35da6d55-2618-46e8-aac4-0b9e881dd44b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d491f98c-76ec-480c-826f-2f17ac096321", "tag": "ea4a6514-e198-49b8-84f4-1027468a7cf0"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:32:24.608054 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-cd49bd8d-d6ab-44a6-8dc2-9863f5d18bde req-35da6d55-2618-46e8-aac4-0b9e881dd44b service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:24.608541 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-cd49bd8d-d6ab-44a6-8dc2-9863f5d18bde req-35da6d55-2618-46e8-aac4-0b9e881dd44b service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:24.608979 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-cd49bd8d-d6ab-44a6-8dc2-9863f5d18bde req-35da6d55-2618-46e8-aac4-0b9e881dd44b service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:24.623238 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-cd49bd8d-d6ab-44a6-8dc2-9863f5d18bde req-35da6d55-2618-46e8-aac4-0b9e881dd44b service nova] Creating event network-changed:ea4a6514-e198-49b8-84f4-1027468a7cf0 for instance d491f98c-76ec-480c-826f-2f17ac096321 on hv-cinder-86155 Oct 17 04:32:24.628414 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-cd49bd8d-d6ab-44a6-8dc2-9863f5d18bde req-35da6d55-2618-46e8-aac4-0b9e881dd44b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055717 Oct 17 04:32:24.629167 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 82/169] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:32:24.681683 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6d495b18-4f73-4470-afd0-fb1b89649392 tempest-VolumesGetTestJSON-360760555 tempest-VolumesGetTestJSON-360760555-project] Calling method '.version_select at 0x7fc631087af0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:24.710984 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-6d495b18-4f73-4470-afd0-fb1b89649392 tempest-VolumesGetTestJSON-360760555 tempest-VolumesGetTestJSON-360760555-project] HTTP exception thrown: Volume 64016029-a55f-4a75-b091-4fa191b1332c could not be found. Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6d495b18-4f73-4470-afd0-fb1b89649392 tempest-VolumesGetTestJSON-360760555 tempest-VolumesGetTestJSON-360760555-project] Request method failure captured: Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: GET /compute/v2.1/os-volumes/64016029-a55f-4a75-b091-4fa191b1332c HTTP/1.1 Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNrVD3fmk7EULrrGAjvppwbotfplksTIjXrs8-ea7RsErPeYkgvujRJdnH04flGQoxM6uNYHkx9ZrRsmMBuCfegykBQm2w4aA70IeQhTqk0KhMmoyZRMjChgrTAEvCFmF6uFR7RqqJg3lGOTzC6lNkS5sdKEez6xMQ2jzb1Ds44UZLQ Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: 602ec68b1eec4ea4a6813b39512a217f Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-VolumesGetTestJSON-360760555 Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:32:24.714946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:32:24.716177 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/602ec68b1eec4ea4a6813b39512a217f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_602ec68b1eec4ea4a6813b39512a217f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/602ec68b1eec4ea4a6813b39512a217f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/602ec68b1eec4ea4a6813b39512a217f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:32:24.716177 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-VolumesGetTestJSON-360760555 Oct 17 04:32:24.716177 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: 602ec68b1eec4ea4a6813b39512a217f Oct 17 04:32:24.716177 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-VolumesGetTestJSON-360760555 Oct 17 04:32:24.716177 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-VolumesGetTestJSON-360760555-project Oct 17 04:32:24.716177 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:32:24.716177 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:32:24.716177 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 28c35ff515ba44c4be948057f5836bdb Oct 17 04:32:24.716177 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-VolumesGetTestJSON-360760555-project Oct 17 04:32:24.716177 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: Oct 17 04:32:24.716177 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Volume 64016029-a55f-4a75-b091-4fa191b1332c could not be found. Oct 17 04:32:24.716177 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': '64016029-a55f-4a75-b091-4fa191b1332c'} Oct 17 04:32:24.716177 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:32:24.716961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:24.716961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:32:24.716961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:32:24.716961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 04:32:24.716961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 04:32:24.716961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 04:32:24.716961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 04:32:24.716961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 04:32:24.716961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 04:32:24.716961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 04:32:24.716961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 04:32:24.716961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:32:24.716961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:32:24.716961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:32:24.716961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:32:24.716961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 64016029-a55f-4a75-b091-4fa191b1332c could not be found. (HTTP 404) (Request-ID: req-ac21b843-6b1b-4835-b48c-650cc702b52e) Oct 17 04:32:24.716961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:24.716961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:32:24.716961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:24.718532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:24.718532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 04:32:24.718532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 04:32:24.718532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 04:32:24.718532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 04:32:24.718532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 04:32:24.718532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 04:32:24.718532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 04:32:24.718532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 04:32:24.718532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:32:24.718532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:32:24.718532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 04:32:24.718532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 04:32:24.718532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 04:32:24.718532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 04:32:24.718532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 04:32:24.718532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 04:32:24.718532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 04:32:24.718532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 04:32:24.719536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:32:24.719536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:32:24.719536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:32:24.719536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:32:24.719536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 64016029-a55f-4a75-b091-4fa191b1332c could not be found. Oct 17 04:32:24.719536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:24.719536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:32:24.719536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:24.719536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:24.719536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:32:24.719536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:32:24.719536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:32:24.719536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:32:24.719536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 04:32:24.719536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 04:32:24.719536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:32:24.719536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:32:24.719536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 04:32:24.719536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:32:24.721928 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 64016029-a55f-4a75-b091-4fa191b1332c could not be found. Oct 17 04:32:24.721928 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:24.721928 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:32:24.721928 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:24.721928 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:24.721928 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:32:24.721928 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:32:24.721928 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:32:24.721928 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:32:24.721928 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 64016029-a55f-4a75-b091-4fa191b1332c could not be found. Oct 17 04:32:24.721928 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:24.721928 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6d495b18-4f73-4470-afd0-fb1b89649392 tempest-VolumesGetTestJSON-360760555 tempest-VolumesGetTestJSON-360760555-project] Returning 404 to user: Volume 64016029-a55f-4a75-b091-4fa191b1332c could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:32:24.721928 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6d495b18-4f73-4470-afd0-fb1b89649392 tempest-VolumesGetTestJSON-360760555 tempest-VolumesGetTestJSON-360760555-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/64016029-a55f-4a75-b091-4fa191b1332c" status: 404 len: 109 microversion: 2.1 time: 0.039644 Oct 17 04:32:24.721928 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 88/170] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Oct 17 04:32:24 2022] GET /compute/v2.1/os-volumes/64016029-a55f-4a75-b091-4fa191b1332c => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 04:32:24.852160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-38852bc4-80b1-4d10-955f-18c7f22e82a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:32:24.856410 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-38852bc4-80b1-4d10-955f-18c7f22e82a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:24.864969 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38852bc4-80b1-4d10-955f-18c7f22e82a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:24.866194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38852bc4-80b1-4d10-955f-18c7f22e82a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:24.866640 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38852bc4-80b1-4d10-955f-18c7f22e82a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:24.867913 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38852bc4-80b1-4d10-955f-18c7f22e82a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:24.868370 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38852bc4-80b1-4d10-955f-18c7f22e82a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:24.868793 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38852bc4-80b1-4d10-955f-18c7f22e82a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:24.902893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-38852bc4-80b1-4d10-955f-18c7f22e82a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lazy-loading 'flavor' on Instance uuid 9d8b2344-7541-41fa-b97f-734e7220308c {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:32:24.936464 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:32:25.077230 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-38852bc4-80b1-4d10-955f-18c7f22e82a2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "POST /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c/action" status: 200 len: 32 microversion: 2.1 time: 0.229152 Oct 17 04:32:25.077866 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 83/171] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Oct 17 04:32:24 2022] POST /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 04:32:25.092230 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-373080cb-e70d-41b5-9f34-30806d008c5b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:25.092956 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-373080cb-e70d-41b5-9f34-30806d008c5b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:25.100660 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-373080cb-e70d-41b5-9f34-30806d008c5b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:25.101392 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-373080cb-e70d-41b5-9f34-30806d008c5b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:25.102055 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-373080cb-e70d-41b5-9f34-30806d008c5b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:25.102982 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-373080cb-e70d-41b5-9f34-30806d008c5b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:25.105334 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-373080cb-e70d-41b5-9f34-30806d008c5b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:25.106284 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-373080cb-e70d-41b5-9f34-30806d008c5b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:25.440050 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-373080cb-e70d-41b5-9f34-30806d008c5b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:25.450295 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-373080cb-e70d-41b5-9f34-30806d008c5b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.366751 Oct 17 04:32:25.451404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 89/172] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:25 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:25.508814 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2c9f11c8-687a-451e-aa4f-5f8fc6b89a10 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:25.510037 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2c9f11c8-687a-451e-aa4f-5f8fc6b89a10 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:25.528240 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c9f11c8-687a-451e-aa4f-5f8fc6b89a10 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:25.529356 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c9f11c8-687a-451e-aa4f-5f8fc6b89a10 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:25.530066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c9f11c8-687a-451e-aa4f-5f8fc6b89a10 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:25.531205 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c9f11c8-687a-451e-aa4f-5f8fc6b89a10 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:25.531953 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c9f11c8-687a-451e-aa4f-5f8fc6b89a10 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:25.532664 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2c9f11c8-687a-451e-aa4f-5f8fc6b89a10 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:25.863506 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-2c9f11c8-687a-451e-aa4f-5f8fc6b89a10 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:25.873016 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2c9f11c8-687a-451e-aa4f-5f8fc6b89a10 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1313 microversion: 2.1 time: 0.371582 Oct 17 04:32:25.873861 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 84/173] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:25 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:26.475074 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-50277ce1-5786-4417-8eb7-dde685308f3d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:26.475888 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-50277ce1-5786-4417-8eb7-dde685308f3d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:26.488157 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50277ce1-5786-4417-8eb7-dde685308f3d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:26.488768 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50277ce1-5786-4417-8eb7-dde685308f3d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:26.489261 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50277ce1-5786-4417-8eb7-dde685308f3d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:26.489958 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50277ce1-5786-4417-8eb7-dde685308f3d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:26.490634 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50277ce1-5786-4417-8eb7-dde685308f3d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:26.491114 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50277ce1-5786-4417-8eb7-dde685308f3d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:26.661608 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-50277ce1-5786-4417-8eb7-dde685308f3d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:26.671287 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-50277ce1-5786-4417-8eb7-dde685308f3d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.200887 Oct 17 04:32:26.671869 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 90/174] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:26 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:26.899697 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ba7beb90-f9a8-4aa8-917c-2a79de9ea0f4 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:26.900311 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ba7beb90-f9a8-4aa8-917c-2a79de9ea0f4 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:26.908328 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba7beb90-f9a8-4aa8-917c-2a79de9ea0f4 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:26.908821 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba7beb90-f9a8-4aa8-917c-2a79de9ea0f4 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:26.913324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba7beb90-f9a8-4aa8-917c-2a79de9ea0f4 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:26.914305 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba7beb90-f9a8-4aa8-917c-2a79de9ea0f4 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:26.914822 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba7beb90-f9a8-4aa8-917c-2a79de9ea0f4 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:26.916067 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ba7beb90-f9a8-4aa8-917c-2a79de9ea0f4 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:27.165747 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-ba7beb90-f9a8-4aa8-917c-2a79de9ea0f4 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:27.177370 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ba7beb90-f9a8-4aa8-917c-2a79de9ea0f4 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1313 microversion: 2.1 time: 0.281398 Oct 17 04:32:27.177955 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 85/175] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:26 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:27.696103 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-edad51e5-2d1f-4a97-b7a0-9097567c207f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:27.696103 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-edad51e5-2d1f-4a97-b7a0-9097567c207f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:27.699449 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=54 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:32:27.706301 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-edad51e5-2d1f-4a97-b7a0-9097567c207f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:27.706904 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-edad51e5-2d1f-4a97-b7a0-9097567c207f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:27.707202 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-edad51e5-2d1f-4a97-b7a0-9097567c207f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:27.707893 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-edad51e5-2d1f-4a97-b7a0-9097567c207f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:27.708342 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-edad51e5-2d1f-4a97-b7a0-9097567c207f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:27.708758 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-edad51e5-2d1f-4a97-b7a0-9097567c207f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:27.882344 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-edad51e5-2d1f-4a97-b7a0-9097567c207f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:27.893823 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-edad51e5-2d1f-4a97-b7a0-9097567c207f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.203058 Oct 17 04:32:27.894301 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 91/176] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:27 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:28.204904 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-865662c0-46c9-4e75-aaf9-a32de1450e33 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:28.205579 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-865662c0-46c9-4e75-aaf9-a32de1450e33 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:28.212475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-865662c0-46c9-4e75-aaf9-a32de1450e33 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:28.212967 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-865662c0-46c9-4e75-aaf9-a32de1450e33 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:28.213475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-865662c0-46c9-4e75-aaf9-a32de1450e33 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:28.214259 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-865662c0-46c9-4e75-aaf9-a32de1450e33 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:28.216236 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-865662c0-46c9-4e75-aaf9-a32de1450e33 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:28.216685 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-865662c0-46c9-4e75-aaf9-a32de1450e33 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:28.408763 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-865662c0-46c9-4e75-aaf9-a32de1450e33 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:28.417446 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-865662c0-46c9-4e75-aaf9-a32de1450e33 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1313 microversion: 2.1 time: 0.215911 Oct 17 04:32:28.420354 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 86/177] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:28 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:28.916197 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-28244b64-83f7-4394-b868-038acb909c66 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:28.917100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-28244b64-83f7-4394-b868-038acb909c66 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:28.923720 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28244b64-83f7-4394-b868-038acb909c66 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:28.924312 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28244b64-83f7-4394-b868-038acb909c66 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:28.924814 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28244b64-83f7-4394-b868-038acb909c66 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:28.925803 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28244b64-83f7-4394-b868-038acb909c66 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:28.926344 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28244b64-83f7-4394-b868-038acb909c66 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:28.926836 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28244b64-83f7-4394-b868-038acb909c66 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:29.078442 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-28244b64-83f7-4394-b868-038acb909c66 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:29.087000 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-28244b64-83f7-4394-b868-038acb909c66 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.174912 Oct 17 04:32:29.090951 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 92/178] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:28 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:29.444918 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1e647316-16e1-4a58-bc2c-a95052c12d80 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:29.445717 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1e647316-16e1-4a58-bc2c-a95052c12d80 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:29.465117 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e647316-16e1-4a58-bc2c-a95052c12d80 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:29.466295 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e647316-16e1-4a58-bc2c-a95052c12d80 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:29.466918 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e647316-16e1-4a58-bc2c-a95052c12d80 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:29.467787 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e647316-16e1-4a58-bc2c-a95052c12d80 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:29.468440 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e647316-16e1-4a58-bc2c-a95052c12d80 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:29.469056 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e647316-16e1-4a58-bc2c-a95052c12d80 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:29.639762 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-1e647316-16e1-4a58-bc2c-a95052c12d80 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:29.651708 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1e647316-16e1-4a58-bc2c-a95052c12d80 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1313 microversion: 2.1 time: 0.212384 Oct 17 04:32:29.653526 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 87/179] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:29 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:30.113666 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d7c92e76-c869-47e5-88c7-d45677380402 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:30.114284 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d7c92e76-c869-47e5-88c7-d45677380402 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:30.122144 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7c92e76-c869-47e5-88c7-d45677380402 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:30.122634 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7c92e76-c869-47e5-88c7-d45677380402 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:30.123263 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7c92e76-c869-47e5-88c7-d45677380402 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:30.123976 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7c92e76-c869-47e5-88c7-d45677380402 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:30.124437 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7c92e76-c869-47e5-88c7-d45677380402 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:30.124895 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7c92e76-c869-47e5-88c7-d45677380402 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:30.268150 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-d7c92e76-c869-47e5-88c7-d45677380402 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:30.278283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d7c92e76-c869-47e5-88c7-d45677380402 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.168464 Oct 17 04:32:30.278870 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 93/180] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:30 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:30.471058 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-dc07af94-d68b-4acf-8f68-c05d4e569bbe req-417ea299-3982-4b90-ab8c-46dfe8e7d16d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d491f98c-76ec-480c-826f-2f17ac096321", "name": "network-vif-plugged", "status": "completed", "tag": "ea4a6514-e198-49b8-84f4-1027468a7cf0"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:32:30.482594 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-dc07af94-d68b-4acf-8f68-c05d4e569bbe req-417ea299-3982-4b90-ab8c-46dfe8e7d16d service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:30.483780 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-dc07af94-d68b-4acf-8f68-c05d4e569bbe req-417ea299-3982-4b90-ab8c-46dfe8e7d16d service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:30.484604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-dc07af94-d68b-4acf-8f68-c05d4e569bbe req-417ea299-3982-4b90-ab8c-46dfe8e7d16d service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:30.500628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-dc07af94-d68b-4acf-8f68-c05d4e569bbe req-417ea299-3982-4b90-ab8c-46dfe8e7d16d service nova] Creating event network-vif-plugged:ea4a6514-e198-49b8-84f4-1027468a7cf0 for instance d491f98c-76ec-480c-826f-2f17ac096321 on hv-cinder-86155 Oct 17 04:32:30.506857 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-dc07af94-d68b-4acf-8f68-c05d4e569bbe req-417ea299-3982-4b90-ab8c-46dfe8e7d16d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039585 Oct 17 04:32:30.508084 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 88/181] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:32:30.683368 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0accd32a-703b-4b5d-bff8-9d28e92baf97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:30.684578 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0accd32a-703b-4b5d-bff8-9d28e92baf97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:30.691739 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0accd32a-703b-4b5d-bff8-9d28e92baf97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:30.692402 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0accd32a-703b-4b5d-bff8-9d28e92baf97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:30.692840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0accd32a-703b-4b5d-bff8-9d28e92baf97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:30.693581 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0accd32a-703b-4b5d-bff8-9d28e92baf97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:30.694126 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0accd32a-703b-4b5d-bff8-9d28e92baf97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:30.694459 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0accd32a-703b-4b5d-bff8-9d28e92baf97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:30.941984 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:32:30.969563 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-0accd32a-703b-4b5d-bff8-9d28e92baf97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:30.977428 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0accd32a-703b-4b5d-bff8-9d28e92baf97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1313 microversion: 2.1 time: 0.298886 Oct 17 04:32:30.978074 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 94/182] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:30 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:31.298403 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:32:31.299966 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:32:31.304123 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b32babf0-5bfd-4dcc-ae78-d287d86be090 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:31.304946 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b32babf0-5bfd-4dcc-ae78-d287d86be090 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:31.315517 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b32babf0-5bfd-4dcc-ae78-d287d86be090 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:31.315517 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b32babf0-5bfd-4dcc-ae78-d287d86be090 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:31.315926 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b32babf0-5bfd-4dcc-ae78-d287d86be090 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:31.316769 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b32babf0-5bfd-4dcc-ae78-d287d86be090 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:31.317634 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b32babf0-5bfd-4dcc-ae78-d287d86be090 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:31.319405 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b32babf0-5bfd-4dcc-ae78-d287d86be090 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:31.472307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-b32babf0-5bfd-4dcc-ae78-d287d86be090 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:31.482680 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b32babf0-5bfd-4dcc-ae78-d287d86be090 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.185119 Oct 17 04:32:31.483594 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 89/183] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:31 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:32.002599 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dfde80a8-2f92-4159-a9a1-f0187adb83ae tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:32.003218 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dfde80a8-2f92-4159-a9a1-f0187adb83ae tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:32.009936 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfde80a8-2f92-4159-a9a1-f0187adb83ae tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:32.010664 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfde80a8-2f92-4159-a9a1-f0187adb83ae tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:32.011110 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfde80a8-2f92-4159-a9a1-f0187adb83ae tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:32.011998 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfde80a8-2f92-4159-a9a1-f0187adb83ae tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:32.012436 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfde80a8-2f92-4159-a9a1-f0187adb83ae tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:32.013026 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dfde80a8-2f92-4159-a9a1-f0187adb83ae tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:32.232840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-dfde80a8-2f92-4159-a9a1-f0187adb83ae tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:32.255683 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dfde80a8-2f92-4159-a9a1-f0187adb83ae tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1313 microversion: 2.1 time: 0.256887 Oct 17 04:32:32.256691 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 95/184] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:31 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:32.506189 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-10d5b56a-5ac5-4d8f-9f5e-f47c6bf5dd8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:32.507382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-10d5b56a-5ac5-4d8f-9f5e-f47c6bf5dd8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:32.514538 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10d5b56a-5ac5-4d8f-9f5e-f47c6bf5dd8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:32.515348 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10d5b56a-5ac5-4d8f-9f5e-f47c6bf5dd8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:32.515960 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10d5b56a-5ac5-4d8f-9f5e-f47c6bf5dd8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:32.516728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10d5b56a-5ac5-4d8f-9f5e-f47c6bf5dd8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:32.517372 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10d5b56a-5ac5-4d8f-9f5e-f47c6bf5dd8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:32.517802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-10d5b56a-5ac5-4d8f-9f5e-f47c6bf5dd8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:32.745408 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-10d5b56a-5ac5-4d8f-9f5e-f47c6bf5dd8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:32.753499 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-10d5b56a-5ac5-4d8f-9f5e-f47c6bf5dd8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.251031 Oct 17 04:32:32.754003 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 90/185] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:32 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:33.280303 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-72b4d200-b7ad-453e-a8dc-3e662ef52831 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:33.281048 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-72b4d200-b7ad-453e-a8dc-3e662ef52831 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:33.287538 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72b4d200-b7ad-453e-a8dc-3e662ef52831 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:33.288090 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72b4d200-b7ad-453e-a8dc-3e662ef52831 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:33.288589 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72b4d200-b7ad-453e-a8dc-3e662ef52831 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:33.289552 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72b4d200-b7ad-453e-a8dc-3e662ef52831 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:33.289898 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72b4d200-b7ad-453e-a8dc-3e662ef52831 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:33.290384 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-72b4d200-b7ad-453e-a8dc-3e662ef52831 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:33.308890 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:32:33.442815 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-72b4d200-b7ad-453e-a8dc-3e662ef52831 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:33.455173 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-72b4d200-b7ad-453e-a8dc-3e662ef52831 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1497 microversion: 2.1 time: 0.178303 Oct 17 04:32:33.455766 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 96/186] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:33 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:33.783900 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0e5ff4ca-e8ba-483a-a049-843b81649f00 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:33.784508 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0e5ff4ca-e8ba-483a-a049-843b81649f00 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:33.802107 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e5ff4ca-e8ba-483a-a049-843b81649f00 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:33.802664 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e5ff4ca-e8ba-483a-a049-843b81649f00 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:33.803156 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e5ff4ca-e8ba-483a-a049-843b81649f00 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:33.804197 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e5ff4ca-e8ba-483a-a049-843b81649f00 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:33.804698 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e5ff4ca-e8ba-483a-a049-843b81649f00 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:33.805282 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0e5ff4ca-e8ba-483a-a049-843b81649f00 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:33.965397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-0e5ff4ca-e8ba-483a-a049-843b81649f00 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:33.974603 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0e5ff4ca-e8ba-483a-a049-843b81649f00 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.194468 Oct 17 04:32:33.975201 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 91/187] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:33 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:34.007469 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9dac33bc-d7f7-4a76-a7f5-c6d965fd0ef0 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:34.008635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9dac33bc-d7f7-4a76-a7f5-c6d965fd0ef0 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:34.014677 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9dac33bc-d7f7-4a76-a7f5-c6d965fd0ef0 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:34.015171 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9dac33bc-d7f7-4a76-a7f5-c6d965fd0ef0 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:34.015611 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9dac33bc-d7f7-4a76-a7f5-c6d965fd0ef0 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:34.016306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9dac33bc-d7f7-4a76-a7f5-c6d965fd0ef0 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:34.016765 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9dac33bc-d7f7-4a76-a7f5-c6d965fd0ef0 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:34.017221 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9dac33bc-d7f7-4a76-a7f5-c6d965fd0ef0 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:34.043186 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9dac33bc-d7f7-4a76-a7f5-c6d965fd0ef0 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:32:34.134141 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9dac33bc-d7f7-4a76-a7f5-c6d965fd0ef0 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 204 len: 0 microversion: 2.1 time: 0.130210 Oct 17 04:32:34.142568 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 97/188] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:32:34 2022] DELETE /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:32:34.164724 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-255ae902-8cab-45d8-b746-f60c8b658b5b tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:34.164724 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-255ae902-8cab-45d8-b746-f60c8b658b5b tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:34.164724 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-255ae902-8cab-45d8-b746-f60c8b658b5b tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:34.164724 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-255ae902-8cab-45d8-b746-f60c8b658b5b tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:34.165122 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-255ae902-8cab-45d8-b746-f60c8b658b5b tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:34.165122 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-255ae902-8cab-45d8-b746-f60c8b658b5b tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:34.165122 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-255ae902-8cab-45d8-b746-f60c8b658b5b tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:34.165122 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-255ae902-8cab-45d8-b746-f60c8b658b5b tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:34.306356 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-255ae902-8cab-45d8-b746-f60c8b658b5b tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:34.315483 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-255ae902-8cab-45d8-b746-f60c8b658b5b tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1503 microversion: 2.1 time: 0.171209 Oct 17 04:32:34.316383 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 92/189] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:34 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:34.999768 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-05ac5839-9751-4dae-b5e9-0d6fc78a975b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:35.000730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-05ac5839-9751-4dae-b5e9-0d6fc78a975b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:35.007673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05ac5839-9751-4dae-b5e9-0d6fc78a975b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:35.008153 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05ac5839-9751-4dae-b5e9-0d6fc78a975b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:35.008585 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05ac5839-9751-4dae-b5e9-0d6fc78a975b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:35.009303 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05ac5839-9751-4dae-b5e9-0d6fc78a975b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:35.009751 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05ac5839-9751-4dae-b5e9-0d6fc78a975b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:35.010667 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05ac5839-9751-4dae-b5e9-0d6fc78a975b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:35.145489 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-05ac5839-9751-4dae-b5e9-0d6fc78a975b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:35.154718 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-05ac5839-9751-4dae-b5e9-0d6fc78a975b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.159827 Oct 17 04:32:35.155287 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 98/190] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:34 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:35.341650 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e2bbcd85-d83d-40d1-bdda-ddfd241a9006 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:35.342431 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e2bbcd85-d83d-40d1-bdda-ddfd241a9006 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:35.347680 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:32:35.349022 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e2bbcd85-d83d-40d1-bdda-ddfd241a9006 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:35.349788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e2bbcd85-d83d-40d1-bdda-ddfd241a9006 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:35.350239 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e2bbcd85-d83d-40d1-bdda-ddfd241a9006 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:35.351186 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e2bbcd85-d83d-40d1-bdda-ddfd241a9006 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:35.351741 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e2bbcd85-d83d-40d1-bdda-ddfd241a9006 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:35.352414 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e2bbcd85-d83d-40d1-bdda-ddfd241a9006 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:35.492427 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e2bbcd85-d83d-40d1-bdda-ddfd241a9006 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:35.501269 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e2bbcd85-d83d-40d1-bdda-ddfd241a9006 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1503 microversion: 2.1 time: 0.164295 Oct 17 04:32:35.501840 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 93/191] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:35 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:36.177918 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f22a4df5-08f4-465e-89bf-6f5437cffdd2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:36.179086 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f22a4df5-08f4-465e-89bf-6f5437cffdd2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:36.187307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f22a4df5-08f4-465e-89bf-6f5437cffdd2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:36.187802 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f22a4df5-08f4-465e-89bf-6f5437cffdd2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:36.188268 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f22a4df5-08f4-465e-89bf-6f5437cffdd2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:36.189163 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f22a4df5-08f4-465e-89bf-6f5437cffdd2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:36.189646 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f22a4df5-08f4-465e-89bf-6f5437cffdd2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:36.190246 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f22a4df5-08f4-465e-89bf-6f5437cffdd2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:36.323945 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f22a4df5-08f4-465e-89bf-6f5437cffdd2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:36.332474 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f22a4df5-08f4-465e-89bf-6f5437cffdd2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.158558 Oct 17 04:32:36.333046 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 99/192] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:36 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:36.525199 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0f2b4939-b951-4772-ad57-bd319c392b29 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:36.525846 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0f2b4939-b951-4772-ad57-bd319c392b29 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:36.531786 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f2b4939-b951-4772-ad57-bd319c392b29 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:36.532272 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f2b4939-b951-4772-ad57-bd319c392b29 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:36.532711 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f2b4939-b951-4772-ad57-bd319c392b29 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:36.533443 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f2b4939-b951-4772-ad57-bd319c392b29 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:36.533897 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f2b4939-b951-4772-ad57-bd319c392b29 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:36.534320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f2b4939-b951-4772-ad57-bd319c392b29 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:36.658589 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-0f2b4939-b951-4772-ad57-bd319c392b29 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:36.666261 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0f2b4939-b951-4772-ad57-bd319c392b29 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1503 microversion: 2.1 time: 0.144945 Oct 17 04:32:36.667475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 94/193] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:36 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:37.355919 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-31468389-6446-438c-98a1-8ae14f621129 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:37.356530 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-31468389-6446-438c-98a1-8ae14f621129 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:37.363005 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31468389-6446-438c-98a1-8ae14f621129 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:37.363486 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31468389-6446-438c-98a1-8ae14f621129 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:37.363930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31468389-6446-438c-98a1-8ae14f621129 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:37.364622 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31468389-6446-438c-98a1-8ae14f621129 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:37.365161 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31468389-6446-438c-98a1-8ae14f621129 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:37.365529 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-31468389-6446-438c-98a1-8ae14f621129 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:37.493719 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-31468389-6446-438c-98a1-8ae14f621129 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:37.501706 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-31468389-6446-438c-98a1-8ae14f621129 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.149732 Oct 17 04:32:37.502284 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 100/194] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:37 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:37.689640 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5c5f6646-953f-4664-9bd8-582aa0e7f6bb tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:37.690254 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5c5f6646-953f-4664-9bd8-582aa0e7f6bb tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:37.696028 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c5f6646-953f-4664-9bd8-582aa0e7f6bb tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:37.696506 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c5f6646-953f-4664-9bd8-582aa0e7f6bb tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:37.696941 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c5f6646-953f-4664-9bd8-582aa0e7f6bb tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:37.698211 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c5f6646-953f-4664-9bd8-582aa0e7f6bb tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:37.698672 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c5f6646-953f-4664-9bd8-582aa0e7f6bb tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:37.699093 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5c5f6646-953f-4664-9bd8-582aa0e7f6bb tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:37.879172 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-5c5f6646-953f-4664-9bd8-582aa0e7f6bb tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:37.891084 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5c5f6646-953f-4664-9bd8-582aa0e7f6bb tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1503 microversion: 2.1 time: 0.205137 Oct 17 04:32:37.892006 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 95/195] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:37 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:38.413949 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-73d33681-fd29-42e3-96d6-6cb9201b854f req-36c1d467-e61b-4b67-9998-ab0dbcd75719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d491f98c-76ec-480c-826f-2f17ac096321", "name": "network-vif-deleted", "tag": "ea4a6514-e198-49b8-84f4-1027468a7cf0"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:32:38.423705 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-73d33681-fd29-42e3-96d6-6cb9201b854f req-36c1d467-e61b-4b67-9998-ab0dbcd75719 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:38.424171 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-73d33681-fd29-42e3-96d6-6cb9201b854f req-36c1d467-e61b-4b67-9998-ab0dbcd75719 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:38.424595 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-73d33681-fd29-42e3-96d6-6cb9201b854f req-36c1d467-e61b-4b67-9998-ab0dbcd75719 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:38.435858 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-73d33681-fd29-42e3-96d6-6cb9201b854f req-36c1d467-e61b-4b67-9998-ab0dbcd75719 service nova] Creating event network-vif-deleted:ea4a6514-e198-49b8-84f4-1027468a7cf0 for instance d491f98c-76ec-480c-826f-2f17ac096321 on hv-cinder-86155 Oct 17 04:32:38.440782 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-73d33681-fd29-42e3-96d6-6cb9201b854f req-36c1d467-e61b-4b67-9998-ab0dbcd75719 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030577 Oct 17 04:32:38.441419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 101/196] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:32:38.524592 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-65b52caa-6cab-4ac6-8496-1aee60147303 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:38.525238 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-65b52caa-6cab-4ac6-8496-1aee60147303 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:38.531764 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65b52caa-6cab-4ac6-8496-1aee60147303 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:38.532256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65b52caa-6cab-4ac6-8496-1aee60147303 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:38.532669 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65b52caa-6cab-4ac6-8496-1aee60147303 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:38.533380 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65b52caa-6cab-4ac6-8496-1aee60147303 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:38.533824 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65b52caa-6cab-4ac6-8496-1aee60147303 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:38.534239 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-65b52caa-6cab-4ac6-8496-1aee60147303 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:38.669793 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-65b52caa-6cab-4ac6-8496-1aee60147303 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:38.677953 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-65b52caa-6cab-4ac6-8496-1aee60147303 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.156971 Oct 17 04:32:38.678528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 96/197] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:38 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:38.915055 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e2b30ca1-dd19-40f1-84cd-23652c69caef tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:38.915661 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e2b30ca1-dd19-40f1-84cd-23652c69caef tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:38.922486 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2b30ca1-dd19-40f1-84cd-23652c69caef tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:38.922953 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2b30ca1-dd19-40f1-84cd-23652c69caef tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:38.923378 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2b30ca1-dd19-40f1-84cd-23652c69caef tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:38.924047 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2b30ca1-dd19-40f1-84cd-23652c69caef tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:38.924502 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2b30ca1-dd19-40f1-84cd-23652c69caef tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:38.924914 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2b30ca1-dd19-40f1-84cd-23652c69caef tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:38.987958 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e2b30ca1-dd19-40f1-84cd-23652c69caef tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:38.996461 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e2b30ca1-dd19-40f1-84cd-23652c69caef tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1461 microversion: 2.1 time: 0.085665 Oct 17 04:32:38.997020 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 102/198] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:38 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1461 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:39.702503 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3e47b4a0-4bc2-4c2d-858f-bfe61d7cff9e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:39.703110 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3e47b4a0-4bc2-4c2d-858f-bfe61d7cff9e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:39.726493 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e47b4a0-4bc2-4c2d-858f-bfe61d7cff9e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:39.727030 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e47b4a0-4bc2-4c2d-858f-bfe61d7cff9e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:39.727582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e47b4a0-4bc2-4c2d-858f-bfe61d7cff9e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:39.728264 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e47b4a0-4bc2-4c2d-858f-bfe61d7cff9e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:39.728897 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e47b4a0-4bc2-4c2d-858f-bfe61d7cff9e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:39.729951 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3e47b4a0-4bc2-4c2d-858f-bfe61d7cff9e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:39.863964 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3e47b4a0-4bc2-4c2d-858f-bfe61d7cff9e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:39.873015 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3e47b4a0-4bc2-4c2d-858f-bfe61d7cff9e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.175786 Oct 17 04:32:39.873618 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 97/199] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:39 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:40.019476 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-844539bc-c48a-45a4-8b62-0076be594778 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:40.020034 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-844539bc-c48a-45a4-8b62-0076be594778 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:40.026490 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-844539bc-c48a-45a4-8b62-0076be594778 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:40.026968 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-844539bc-c48a-45a4-8b62-0076be594778 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:40.027402 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-844539bc-c48a-45a4-8b62-0076be594778 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:40.028086 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-844539bc-c48a-45a4-8b62-0076be594778 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:40.028537 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-844539bc-c48a-45a4-8b62-0076be594778 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:40.028956 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-844539bc-c48a-45a4-8b62-0076be594778 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:40.061051 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-844539bc-c48a-45a4-8b62-0076be594778 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:40.061551 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-844539bc-c48a-45a4-8b62-0076be594778 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:40.061978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-844539bc-c48a-45a4-8b62-0076be594778 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:40.062412 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-844539bc-c48a-45a4-8b62-0076be594778 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lazy-loading 'fault' on Instance uuid d491f98c-76ec-480c-826f-2f17ac096321 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:32:40.104352 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-844539bc-c48a-45a4-8b62-0076be594778 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:40.111777 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-844539bc-c48a-45a4-8b62-0076be594778 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1303 microversion: 2.1 time: 0.096244 Oct 17 04:32:40.112339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 103/200] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:40 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:40.896444 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-26bea764-386a-4de1-b6d1-5bac82805347 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:40.897060 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-26bea764-386a-4de1-b6d1-5bac82805347 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:40.903708 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-26bea764-386a-4de1-b6d1-5bac82805347 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:40.904192 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-26bea764-386a-4de1-b6d1-5bac82805347 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:40.904628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-26bea764-386a-4de1-b6d1-5bac82805347 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:40.905338 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-26bea764-386a-4de1-b6d1-5bac82805347 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:40.905791 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-26bea764-386a-4de1-b6d1-5bac82805347 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:40.906211 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-26bea764-386a-4de1-b6d1-5bac82805347 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:41.036140 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-26bea764-386a-4de1-b6d1-5bac82805347 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:41.043732 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-26bea764-386a-4de1-b6d1-5bac82805347 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.151129 Oct 17 04:32:41.044302 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 98/201] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:40 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:41.135629 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8cd67da8-f882-44f7-aba9-ae419c9f584e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:41.136231 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8cd67da8-f882-44f7-aba9-ae419c9f584e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:41.142971 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cd67da8-f882-44f7-aba9-ae419c9f584e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:41.143459 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cd67da8-f882-44f7-aba9-ae419c9f584e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:41.143897 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cd67da8-f882-44f7-aba9-ae419c9f584e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:41.144592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cd67da8-f882-44f7-aba9-ae419c9f584e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:41.145049 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cd67da8-f882-44f7-aba9-ae419c9f584e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:41.145500 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cd67da8-f882-44f7-aba9-ae419c9f584e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:41.311868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cd67da8-f882-44f7-aba9-ae419c9f584e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:41.312350 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cd67da8-f882-44f7-aba9-ae419c9f584e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:41.312794 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8cd67da8-f882-44f7-aba9-ae419c9f584e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:41.313285 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-8cd67da8-f882-44f7-aba9-ae419c9f584e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lazy-loading 'fault' on Instance uuid d491f98c-76ec-480c-826f-2f17ac096321 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:32:41.352725 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-8cd67da8-f882-44f7-aba9-ae419c9f584e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:41.360367 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8cd67da8-f882-44f7-aba9-ae419c9f584e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1303 microversion: 2.1 time: 0.229139 Oct 17 04:32:41.360931 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 104/202] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:41 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1303 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:32:42.066512 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-033d6caa-aa59-4fb0-b096-04831c9cb82f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:42.067032 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-033d6caa-aa59-4fb0-b096-04831c9cb82f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:42.073578 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-033d6caa-aa59-4fb0-b096-04831c9cb82f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:42.074063 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-033d6caa-aa59-4fb0-b096-04831c9cb82f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:42.074499 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-033d6caa-aa59-4fb0-b096-04831c9cb82f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:42.075182 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-033d6caa-aa59-4fb0-b096-04831c9cb82f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:42.075633 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-033d6caa-aa59-4fb0-b096-04831c9cb82f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:42.076052 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-033d6caa-aa59-4fb0-b096-04831c9cb82f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:42.080238 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:32:42.203659 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-033d6caa-aa59-4fb0-b096-04831c9cb82f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:42.211265 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-033d6caa-aa59-4fb0-b096-04831c9cb82f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.148685 Oct 17 04:32:42.211833 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 99/203] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:42 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:42.383181 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aa98696d-385b-4de0-8b0e-bb4b77def3d9 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:42.383797 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-aa98696d-385b-4de0-8b0e-bb4b77def3d9 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:42.390855 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa98696d-385b-4de0-8b0e-bb4b77def3d9 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:42.391341 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa98696d-385b-4de0-8b0e-bb4b77def3d9 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:42.391780 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa98696d-385b-4de0-8b0e-bb4b77def3d9 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:42.392468 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa98696d-385b-4de0-8b0e-bb4b77def3d9 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:42.392922 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa98696d-385b-4de0-8b0e-bb4b77def3d9 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:42.393377 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa98696d-385b-4de0-8b0e-bb4b77def3d9 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:42.423824 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa98696d-385b-4de0-8b0e-bb4b77def3d9 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:42.424303 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa98696d-385b-4de0-8b0e-bb4b77def3d9 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:42.424735 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-aa98696d-385b-4de0-8b0e-bb4b77def3d9 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:42.425234 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-aa98696d-385b-4de0-8b0e-bb4b77def3d9 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lazy-loading 'fault' on Instance uuid d491f98c-76ec-480c-826f-2f17ac096321 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:32:42.465212 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-aa98696d-385b-4de0-8b0e-bb4b77def3d9 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:42.472748 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aa98696d-385b-4de0-8b0e-bb4b77def3d9 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1303 microversion: 2.1 time: 0.093464 Oct 17 04:32:42.473338 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 105/204] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:42 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:43.235006 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8c85ba38-a587-4411-bdbf-1c8fd693f038 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:43.235615 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8c85ba38-a587-4411-bdbf-1c8fd693f038 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:43.241543 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c85ba38-a587-4411-bdbf-1c8fd693f038 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:43.242018 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c85ba38-a587-4411-bdbf-1c8fd693f038 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:43.242451 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c85ba38-a587-4411-bdbf-1c8fd693f038 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:43.243128 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c85ba38-a587-4411-bdbf-1c8fd693f038 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:43.243577 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c85ba38-a587-4411-bdbf-1c8fd693f038 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:43.243998 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8c85ba38-a587-4411-bdbf-1c8fd693f038 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:43.494620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-319e089a-2e8f-40cd-9e0c-b9b8a7745544 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:43.495239 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-319e089a-2e8f-40cd-9e0c-b9b8a7745544 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:43.502798 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-319e089a-2e8f-40cd-9e0c-b9b8a7745544 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:43.503292 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-319e089a-2e8f-40cd-9e0c-b9b8a7745544 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:43.503725 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-319e089a-2e8f-40cd-9e0c-b9b8a7745544 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:43.504430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-319e089a-2e8f-40cd-9e0c-b9b8a7745544 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:43.504881 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-319e089a-2e8f-40cd-9e0c-b9b8a7745544 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:43.505336 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-319e089a-2e8f-40cd-9e0c-b9b8a7745544 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:43.542369 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-319e089a-2e8f-40cd-9e0c-b9b8a7745544 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:43.542369 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-319e089a-2e8f-40cd-9e0c-b9b8a7745544 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:43.542736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-319e089a-2e8f-40cd-9e0c-b9b8a7745544 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:43.543619 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-319e089a-2e8f-40cd-9e0c-b9b8a7745544 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lazy-loading 'fault' on Instance uuid d491f98c-76ec-480c-826f-2f17ac096321 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:32:43.598895 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-319e089a-2e8f-40cd-9e0c-b9b8a7745544 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:43.608698 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-319e089a-2e8f-40cd-9e0c-b9b8a7745544 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1303 microversion: 2.1 time: 0.117525 Oct 17 04:32:43.609051 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 106/205] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:43 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:43.626553 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-8c85ba38-a587-4411-bdbf-1c8fd693f038 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:43.634382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8c85ba38-a587-4411-bdbf-1c8fd693f038 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.403232 Oct 17 04:32:43.635005 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 100/206] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:43 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:44.632205 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a1d1551a-2858-4669-b0e9-f2b2cfaf346e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:44.632853 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a1d1551a-2858-4669-b0e9-f2b2cfaf346e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:44.639934 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a1d1551a-2858-4669-b0e9-f2b2cfaf346e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:44.640414 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a1d1551a-2858-4669-b0e9-f2b2cfaf346e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:44.640850 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a1d1551a-2858-4669-b0e9-f2b2cfaf346e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:44.641574 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a1d1551a-2858-4669-b0e9-f2b2cfaf346e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:44.642029 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a1d1551a-2858-4669-b0e9-f2b2cfaf346e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:44.642456 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a1d1551a-2858-4669-b0e9-f2b2cfaf346e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:44.657685 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c27e4dff-8884-4078-bc46-b3a0fe201269 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:44.658302 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c27e4dff-8884-4078-bc46-b3a0fe201269 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:44.664165 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c27e4dff-8884-4078-bc46-b3a0fe201269 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:44.664651 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c27e4dff-8884-4078-bc46-b3a0fe201269 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:44.665112 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c27e4dff-8884-4078-bc46-b3a0fe201269 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:44.665804 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c27e4dff-8884-4078-bc46-b3a0fe201269 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:44.666373 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c27e4dff-8884-4078-bc46-b3a0fe201269 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:44.666906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c27e4dff-8884-4078-bc46-b3a0fe201269 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:44.673222 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a1d1551a-2858-4669-b0e9-f2b2cfaf346e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:44.673695 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a1d1551a-2858-4669-b0e9-f2b2cfaf346e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:44.674124 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a1d1551a-2858-4669-b0e9-f2b2cfaf346e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:44.674560 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-a1d1551a-2858-4669-b0e9-f2b2cfaf346e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lazy-loading 'fault' on Instance uuid d491f98c-76ec-480c-826f-2f17ac096321 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:32:44.716574 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a1d1551a-2858-4669-b0e9-f2b2cfaf346e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:44.724554 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a1d1551a-2858-4669-b0e9-f2b2cfaf346e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1303 microversion: 2.1 time: 0.096295 Oct 17 04:32:44.725343 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 107/207] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:44 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:44.810933 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-c27e4dff-8884-4078-bc46-b3a0fe201269 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:44.818574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c27e4dff-8884-4078-bc46-b3a0fe201269 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.164689 Oct 17 04:32:44.819143 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 101/208] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:44 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:32:45.748141 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a4347ba9-e3e1-4e32-b0c0-fb70c701afbe tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:45.748704 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a4347ba9-e3e1-4e32-b0c0-fb70c701afbe tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:45.755062 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4347ba9-e3e1-4e32-b0c0-fb70c701afbe tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:45.755535 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4347ba9-e3e1-4e32-b0c0-fb70c701afbe tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:45.755966 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4347ba9-e3e1-4e32-b0c0-fb70c701afbe tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:45.756643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4347ba9-e3e1-4e32-b0c0-fb70c701afbe tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:45.757109 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4347ba9-e3e1-4e32-b0c0-fb70c701afbe tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:45.757530 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4347ba9-e3e1-4e32-b0c0-fb70c701afbe tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:45.787401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4347ba9-e3e1-4e32-b0c0-fb70c701afbe tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:45.787865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4347ba9-e3e1-4e32-b0c0-fb70c701afbe tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:45.788295 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4347ba9-e3e1-4e32-b0c0-fb70c701afbe tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:45.788727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-a4347ba9-e3e1-4e32-b0c0-fb70c701afbe tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lazy-loading 'fault' on Instance uuid d491f98c-76ec-480c-826f-2f17ac096321 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:32:45.828265 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a4347ba9-e3e1-4e32-b0c0-fb70c701afbe tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:45.835627 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a4347ba9-e3e1-4e32-b0c0-fb70c701afbe tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 200 len: 1303 microversion: 2.1 time: 0.092308 Oct 17 04:32:45.836186 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 108/209] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:45 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:45.841404 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a07165c0-7ba9-4e37-9f7d-cba780226852 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:45.842126 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a07165c0-7ba9-4e37-9f7d-cba780226852 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:45.848112 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a07165c0-7ba9-4e37-9f7d-cba780226852 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:45.848677 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a07165c0-7ba9-4e37-9f7d-cba780226852 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:45.849211 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a07165c0-7ba9-4e37-9f7d-cba780226852 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:45.850005 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a07165c0-7ba9-4e37-9f7d-cba780226852 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:45.850656 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a07165c0-7ba9-4e37-9f7d-cba780226852 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:45.851090 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a07165c0-7ba9-4e37-9f7d-cba780226852 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:45.981264 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-a07165c0-7ba9-4e37-9f7d-cba780226852 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:45.988901 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a07165c0-7ba9-4e37-9f7d-cba780226852 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.151593 Oct 17 04:32:45.989505 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 102/210] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:45 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:32:46.858361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ae81870-53c3-4b62-a35b-bb5aa21d33e5 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:46.859008 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9ae81870-53c3-4b62-a35b-bb5aa21d33e5 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: d491f98c-76ec-480c-826f-2f17ac096321] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:46.865487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ae81870-53c3-4b62-a35b-bb5aa21d33e5 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:46.865971 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ae81870-53c3-4b62-a35b-bb5aa21d33e5 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:46.866406 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ae81870-53c3-4b62-a35b-bb5aa21d33e5 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:46.867093 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ae81870-53c3-4b62-a35b-bb5aa21d33e5 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:46.867546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ae81870-53c3-4b62-a35b-bb5aa21d33e5 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:46.867967 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ae81870-53c3-4b62-a35b-bb5aa21d33e5 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:46.881613 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-9ae81870-53c3-4b62-a35b-bb5aa21d33e5 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] HTTP exception thrown: Instance d491f98c-76ec-480c-826f-2f17ac096321 could not be found. Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ae81870-53c3-4b62-a35b-bb5aa21d33e5 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Request method failure captured: Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 HTTP/1.1 Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNrRGhNUHFu1WiUJHujQZ8x4UrPgm2bhl2fzvW_iMyYITcUSu9DvVKH1m91jA_eIwushcZgt2qwjVuUUYqkiYCNhA3ry4CMqdhMxaXgyvUDk2ae2Njx8XjCEFCSDfcGCepUudAMJvu4G2HZuzR87GtMvU68fG1y9Gw5w_a9UNxmmY-c Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: 34d5aaa16da54ea19e9c982c50540377 Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-VolumesActionsTest-1182194090 Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:32:46.883316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:32:46.884787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/34d5aaa16da54ea19e9c982c50540377"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_34d5aaa16da54ea19e9c982c50540377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/34d5aaa16da54ea19e9c982c50540377"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/34d5aaa16da54ea19e9c982c50540377"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:32:46.884787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-VolumesActionsTest-1182194090 Oct 17 04:32:46.884787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: 34d5aaa16da54ea19e9c982c50540377 Oct 17 04:32:46.884787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-VolumesActionsTest-1182194090 Oct 17 04:32:46.884787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-VolumesActionsTest-1182194090-project Oct 17 04:32:46.884787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:32:46.884787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:32:46.884787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 3fb7bee3a97e4312ba30451b4a5f980d Oct 17 04:32:46.884787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-VolumesActionsTest-1182194090-project Oct 17 04:32:46.884787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:32:46.884787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance d491f98c-76ec-480c-826f-2f17ac096321 could not be found. Oct 17 04:32:46.884787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': 'd491f98c-76ec-480c-826f-2f17ac096321'} Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d491f98c-76ec-480c-826f-2f17ac096321 could not be found. Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:32:46.887506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:32:46.888827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:32:46.888827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:32:46.888827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:32:46.888827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:32:46.888827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:32:46.888827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:32:46.888827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:32:46.888827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d491f98c-76ec-480c-826f-2f17ac096321 could not be found. Oct 17 04:32:46.888827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:46.888827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:32:46.888827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:46.888827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:46.888827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:32:46.888827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:32:46.888827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:32:46.888827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:32:46.888827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d491f98c-76ec-480c-826f-2f17ac096321 could not be found. Oct 17 04:32:46.888827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:46.889946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ae81870-53c3-4b62-a35b-bb5aa21d33e5 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Returning 404 to user: Instance d491f98c-76ec-480c-826f-2f17ac096321 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:32:46.889946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9ae81870-53c3-4b62-a35b-bb5aa21d33e5 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321" status: 404 len: 111 microversion: 2.1 time: 0.030389 Oct 17 04:32:46.889946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 109/211] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:46 2022] GET /compute/v2.1/servers/d491f98c-76ec-480c-826f-2f17ac096321 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:32:46.987734 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-38d2084f-1f89-4f24-b808-4bb7c60bd2fa tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-671193861", "imageRef": "bf655d8c-fb2f-42ef-a7a7-0386f57b58cf", "flavorRef": "452", "networks": [{"uuid": "41cde4c2-319c-405f-953d-34a4f0f9247a"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:32:47.014597 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b70d61c0-80ce-43c3-b076-76aaf7dd6a05 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:47.015421 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b70d61c0-80ce-43c3-b076-76aaf7dd6a05 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:47.021453 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b70d61c0-80ce-43c3-b076-76aaf7dd6a05 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:47.021940 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b70d61c0-80ce-43c3-b076-76aaf7dd6a05 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:47.022512 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b70d61c0-80ce-43c3-b076-76aaf7dd6a05 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:47.023212 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b70d61c0-80ce-43c3-b076-76aaf7dd6a05 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:47.023791 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b70d61c0-80ce-43c3-b076-76aaf7dd6a05 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:47.024215 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b70d61c0-80ce-43c3-b076-76aaf7dd6a05 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:47.048073 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-38d2084f-1f89-4f24-b808-4bb7c60bd2fa tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] validate_networks() for [('41cde4c2-319c-405f-953d-34a4f0f9247a', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:32:47.251123 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b70d61c0-80ce-43c3-b076-76aaf7dd6a05 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:47.254636 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:32:47.260325 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b70d61c0-80ce-43c3-b076-76aaf7dd6a05 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1502 microversion: 2.1 time: 0.250990 Oct 17 04:32:47.262303 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 110/212] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:47 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1502 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:32:47.284854 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f57f8ca2-45ea-42d0-b586-1a841d6a5197 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94e03bdb-bfbe-4b3c-b773-966cb887c88d"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:32:47.287981 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f57f8ca2-45ea-42d0-b586-1a841d6a5197 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:47.295150 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f57f8ca2-45ea-42d0-b586-1a841d6a5197 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:47.295643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f57f8ca2-45ea-42d0-b586-1a841d6a5197 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:47.296072 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f57f8ca2-45ea-42d0-b586-1a841d6a5197 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:47.296768 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f57f8ca2-45ea-42d0-b586-1a841d6a5197 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:47.297238 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f57f8ca2-45ea-42d0-b586-1a841d6a5197 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:47.297840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f57f8ca2-45ea-42d0-b586-1a841d6a5197 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:47.328026 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-f57f8ca2-45ea-42d0-b586-1a841d6a5197 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] HTTP exception thrown: Cannot 'attach_volume' instance 9d8b2344-7541-41fa-b97f-734e7220308c while it is in vm_state rescued Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f57f8ca2-45ea-42d0-b586-1a841d6a5197 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Request method failure captured: Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c/os-volume_attachments HTTP/1.1 Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 74 Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNqLhF-1OXgaOje4IGVnyezHko7_IZT00YPv9us17-37Q37nMNiHcC_lb8w7eKgJVeRiaXu6_GEjnJM1-HP1OhzVwjZNUQ6agiLoG5Dn6ckIJuDrH2TmKCF4QrHIDvZud13RDaxZYvs15jYkMJ96cW5VSzZewYAyctO5HLh7B5QnLlI Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: 7bd6234b23704bdf809481085ce465eb Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-438926643 Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:32:47.329831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:32:47.331244 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7bd6234b23704bdf809481085ce465eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7bd6234b23704bdf809481085ce465eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7bd6234b23704bdf809481085ce465eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7bd6234b23704bdf809481085ce465eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:32:47.331244 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-ServerRescueNegativeTestJSON-438926643 Oct 17 04:32:47.331244 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: 7bd6234b23704bdf809481085ce465eb Oct 17 04:32:47.331244 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-438926643 Oct 17 04:32:47.331244 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-ServerRescueNegativeTestJSON-438926643-project Oct 17 04:32:47.331244 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:32:47.331244 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:32:47.331244 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 308c01bc66224188aec055c2397a066b Oct 17 04:32:47.331244 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-ServerRescueNegativeTestJSON-438926643-project Oct 17 04:32:47.331244 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Oct 17 04:32:47.331244 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {"volumeAttachment": {"volumeId": "94e03bdb-bfbe-4b3c-b773-966cb887c88d"}} Oct 17 04:32:47.331244 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:32:47.332056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Cannot 'attach_volume' instance 9d8b2344-7541-41fa-b97f-734e7220308c while it is in vm_state rescued Oct 17 04:32:47.332056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'server_id': '9d8b2344-7541-41fa-b97f-734e7220308c', 'body': {'volumeAttachment': {'volumeId': '94e03bdb-bfbe-4b3c-b773-966cb887c88d'}}} Oct 17 04:32:47.332056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:32:47.332056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:47.332056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 04:32:47.332056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 04:32:47.332056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 04:32:47.332056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 04:32:47.332056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 04:32:47.332056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 04:32:47.332056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9d8b2344-7541-41fa-b97f-734e7220308c in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 17 04:32:47.332056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:47.332056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:32:47.332056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:47.332056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:47.332056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:32:47.332056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:32:47.332056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:32:47.332056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:32:47.333835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:32:47.333835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:32:47.333835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 04:32:47.333835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 04:32:47.333835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 04:32:47.333835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 04:32:47.333835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 04:32:47.333835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 04:32:47.333835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 17 04:32:47.333835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 04:32:47.333835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 04:32:47.333835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 04:32:47.333835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9d8b2344-7541-41fa-b97f-734e7220308c while it is in vm_state rescued Oct 17 04:32:47.333835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:47.333835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:32:47.333835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:47.333835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:32:47.333835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:32:47.333835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:32:47.335174 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:32:47.335174 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:32:47.335174 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9d8b2344-7541-41fa-b97f-734e7220308c while it is in vm_state rescued Oct 17 04:32:47.335174 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:32:47.335174 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f57f8ca2-45ea-42d0-b586-1a841d6a5197 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Returning 409 to user: Cannot 'attach_volume' instance 9d8b2344-7541-41fa-b97f-734e7220308c while it is in vm_state rescued {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:32:47.335174 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f57f8ca2-45ea-42d0-b586-1a841d6a5197 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "POST /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051311 Oct 17 04:32:47.335174 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 111/213] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Oct 17 04:32:47 2022] POST /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 04:32:47.354356 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4f3209f6-1882-4dcb-8f9d-63b0bf78c926 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:32:47.356048 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4f3209f6-1882-4dcb-8f9d-63b0bf78c926 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:47.364837 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f3209f6-1882-4dcb-8f9d-63b0bf78c926 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:47.365418 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f3209f6-1882-4dcb-8f9d-63b0bf78c926 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:47.365926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f3209f6-1882-4dcb-8f9d-63b0bf78c926 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:47.367564 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f3209f6-1882-4dcb-8f9d-63b0bf78c926 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:47.368071 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f3209f6-1882-4dcb-8f9d-63b0bf78c926 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:47.368562 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4f3209f6-1882-4dcb-8f9d-63b0bf78c926 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:47.487144 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4f3209f6-1882-4dcb-8f9d-63b0bf78c926 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "POST /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c/action" status: 202 len: 0 microversion: 2.1 time: 0.148047 Oct 17 04:32:47.490936 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 112/214] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Oct 17 04:32:47 2022] POST /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:32:47.497711 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6b7a8e51-a23d-4fe2-89dd-2081a07d0db3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:47.498418 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6b7a8e51-a23d-4fe2-89dd-2081a07d0db3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:47.506105 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6b7a8e51-a23d-4fe2-89dd-2081a07d0db3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:47.506677 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6b7a8e51-a23d-4fe2-89dd-2081a07d0db3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:47.507252 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6b7a8e51-a23d-4fe2-89dd-2081a07d0db3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:47.508080 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6b7a8e51-a23d-4fe2-89dd-2081a07d0db3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:47.508776 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6b7a8e51-a23d-4fe2-89dd-2081a07d0db3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:47.509594 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6b7a8e51-a23d-4fe2-89dd-2081a07d0db3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:47.652544 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-38d2084f-1f89-4f24-b808-4bb7c60bd2fa tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:32:47.652885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-38d2084f-1f89-4f24-b808-4bb7c60bd2fa tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:32:47.654318 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-38d2084f-1f89-4f24-b808-4bb7c60bd2fa tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:32:47.655837 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-38d2084f-1f89-4f24-b808-4bb7c60bd2fa tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:32:47.656325 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-38d2084f-1f89-4f24-b808-4bb7c60bd2fa tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:32:47.672720 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38d2084f-1f89-4f24-b808-4bb7c60bd2fa tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:47.673544 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38d2084f-1f89-4f24-b808-4bb7c60bd2fa tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:47.674042 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38d2084f-1f89-4f24-b808-4bb7c60bd2fa tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:47.674955 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38d2084f-1f89-4f24-b808-4bb7c60bd2fa tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:47.675381 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38d2084f-1f89-4f24-b808-4bb7c60bd2fa tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:47.675879 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-38d2084f-1f89-4f24-b808-4bb7c60bd2fa tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:47.696487 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-38d2084f-1f89-4f24-b808-4bb7c60bd2fa tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Getting quotas for project 34d5aaa16da54ea19e9c982c50540377. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:32:47.703878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-38d2084f-1f89-4f24-b808-4bb7c60bd2fa tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Getting quotas for user 3fb7bee3a97e4312ba30451b4a5f980d and project 34d5aaa16da54ea19e9c982c50540377. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:32:47.717849 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-38d2084f-1f89-4f24-b808-4bb7c60bd2fa tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:32:47.720890 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-38d2084f-1f89-4f24-b808-4bb7c60bd2fa tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf655d8c-fb2f-42ef-a7a7-0386f57b58cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:32:47.777318 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-38d2084f-1f89-4f24-b808-4bb7c60bd2fa tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792778 Oct 17 04:32:47.778621 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 103/215] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:32:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 04:32:47.790578 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-6b7a8e51-a23d-4fe2-89dd-2081a07d0db3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:47.801369 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c9f10f61-1296-4ea6-82d1-f4161b550bb7 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:47.801369 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c9f10f61-1296-4ea6-82d1-f4161b550bb7 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:47.801542 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6b7a8e51-a23d-4fe2-89dd-2081a07d0db3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1510 microversion: 2.1 time: 0.306967 Oct 17 04:32:47.801542 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 113/216] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:47 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1510 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:32:47.865891 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-c9f10f61-1296-4ea6-82d1-f4161b550bb7 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:47.874958 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c9f10f61-1296-4ea6-82d1-f4161b550bb7 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1213 microversion: 2.1 time: 0.089507 Oct 17 04:32:47.875751 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 104/217] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:47 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:48.824214 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-385ed0bc-4c5d-4971-8316-571650aead1e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:48.824843 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-385ed0bc-4c5d-4971-8316-571650aead1e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:48.833891 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-385ed0bc-4c5d-4971-8316-571650aead1e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:48.834380 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-385ed0bc-4c5d-4971-8316-571650aead1e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:48.834816 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-385ed0bc-4c5d-4971-8316-571650aead1e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:48.835710 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-385ed0bc-4c5d-4971-8316-571650aead1e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:48.836320 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-385ed0bc-4c5d-4971-8316-571650aead1e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:48.836898 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-385ed0bc-4c5d-4971-8316-571650aead1e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:48.900778 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0f410a49-99ad-4a6a-a346-576808411a1c tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:48.901422 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0f410a49-99ad-4a6a-a346-576808411a1c tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:48.911065 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f410a49-99ad-4a6a-a346-576808411a1c tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:48.913250 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f410a49-99ad-4a6a-a346-576808411a1c tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:48.914126 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f410a49-99ad-4a6a-a346-576808411a1c tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:48.917180 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f410a49-99ad-4a6a-a346-576808411a1c tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:48.917944 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f410a49-99ad-4a6a-a346-576808411a1c tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:48.918888 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f410a49-99ad-4a6a-a346-576808411a1c tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:49.043940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-0f410a49-99ad-4a6a-a346-576808411a1c tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:49.072038 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0f410a49-99ad-4a6a-a346-576808411a1c tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1265 microversion: 2.1 time: 0.175586 Oct 17 04:32:49.072930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 105/218] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:48 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:32:49.102332 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-385ed0bc-4c5d-4971-8316-571650aead1e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:49.114402 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-385ed0bc-4c5d-4971-8316-571650aead1e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1510 microversion: 2.1 time: 0.295729 Oct 17 04:32:49.114986 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 114/219] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:48 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1510 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:50.097578 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b39dde79-be88-4cce-8f7e-3b7251d1cc6d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:50.098200 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b39dde79-be88-4cce-8f7e-3b7251d1cc6d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:50.105521 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b39dde79-be88-4cce-8f7e-3b7251d1cc6d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:50.106049 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b39dde79-be88-4cce-8f7e-3b7251d1cc6d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:50.106717 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b39dde79-be88-4cce-8f7e-3b7251d1cc6d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:50.107456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b39dde79-be88-4cce-8f7e-3b7251d1cc6d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:50.107916 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b39dde79-be88-4cce-8f7e-3b7251d1cc6d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:50.108538 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b39dde79-be88-4cce-8f7e-3b7251d1cc6d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:50.138454 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b3afcc4c-67ab-46de-97f4-77196392dc8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:50.139608 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b3afcc4c-67ab-46de-97f4-77196392dc8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:50.148082 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3afcc4c-67ab-46de-97f4-77196392dc8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:50.153450 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3afcc4c-67ab-46de-97f4-77196392dc8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:50.155398 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3afcc4c-67ab-46de-97f4-77196392dc8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:50.157135 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3afcc4c-67ab-46de-97f4-77196392dc8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:50.158787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3afcc4c-67ab-46de-97f4-77196392dc8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:50.161442 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3afcc4c-67ab-46de-97f4-77196392dc8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:50.200216 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-b39dde79-be88-4cce-8f7e-3b7251d1cc6d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:50.211820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b39dde79-be88-4cce-8f7e-3b7251d1cc6d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1265 microversion: 2.1 time: 0.119120 Oct 17 04:32:50.212523 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 106/220] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:50 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1265 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:50.365432 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b3afcc4c-67ab-46de-97f4-77196392dc8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:50.374582 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b3afcc4c-67ab-46de-97f4-77196392dc8e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1510 microversion: 2.1 time: 0.240584 Oct 17 04:32:50.375886 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 115/221] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:50 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1510 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:51.237734 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-74e356de-d497-404c-8068-2babb5ecbf96 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:51.238538 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-74e356de-d497-404c-8068-2babb5ecbf96 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:51.249893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74e356de-d497-404c-8068-2babb5ecbf96 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:51.252264 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74e356de-d497-404c-8068-2babb5ecbf96 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:51.253312 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74e356de-d497-404c-8068-2babb5ecbf96 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:51.254231 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74e356de-d497-404c-8068-2babb5ecbf96 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:51.257787 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74e356de-d497-404c-8068-2babb5ecbf96 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:51.258285 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74e356de-d497-404c-8068-2babb5ecbf96 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:51.378256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-74e356de-d497-404c-8068-2babb5ecbf96 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:51.395207 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-74e356de-d497-404c-8068-2babb5ecbf96 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1271 microversion: 2.1 time: 0.157518 Oct 17 04:32:51.404202 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-48e4a3c7-ca48-4517-827f-5f44f90ea4d6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:51.404824 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-48e4a3c7-ca48-4517-827f-5f44f90ea4d6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:51.408623 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 107/222] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:51 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:51.418825 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48e4a3c7-ca48-4517-827f-5f44f90ea4d6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:51.419690 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48e4a3c7-ca48-4517-827f-5f44f90ea4d6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:51.421981 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48e4a3c7-ca48-4517-827f-5f44f90ea4d6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:51.422898 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48e4a3c7-ca48-4517-827f-5f44f90ea4d6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:51.425438 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48e4a3c7-ca48-4517-827f-5f44f90ea4d6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:51.426064 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48e4a3c7-ca48-4517-827f-5f44f90ea4d6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:51.684604 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-48e4a3c7-ca48-4517-827f-5f44f90ea4d6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:51.694098 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-48e4a3c7-ca48-4517-827f-5f44f90ea4d6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1516 microversion: 2.1 time: 0.294695 Oct 17 04:32:51.695187 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 116/223] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:51 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1516 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:32:52.423435 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-039da59f-19aa-4dd5-91fa-c064b0d77dba tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:52.424071 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-039da59f-19aa-4dd5-91fa-c064b0d77dba tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:52.434655 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-039da59f-19aa-4dd5-91fa-c064b0d77dba tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:52.436978 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-039da59f-19aa-4dd5-91fa-c064b0d77dba tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:52.437496 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-039da59f-19aa-4dd5-91fa-c064b0d77dba tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:52.438263 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-039da59f-19aa-4dd5-91fa-c064b0d77dba tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:52.439877 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-039da59f-19aa-4dd5-91fa-c064b0d77dba tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:52.440314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-039da59f-19aa-4dd5-91fa-c064b0d77dba tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:52.776925 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-039da59f-19aa-4dd5-91fa-c064b0d77dba tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:52.785323 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-039da59f-19aa-4dd5-91fa-c064b0d77dba tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1313 microversion: 2.1 time: 0.366038 Oct 17 04:32:52.801777 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 108/224] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:52 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:53.377428 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c8f2da35-87da-4692-b295-13b6fd1aff65 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Action: 'create', calling method: .version_select at 0x7fc6312535e0>, body: {"keypair": {"name": "tempest-keypair-1239879014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqcudpNpT9uyAdvmZvlAw1GpXKv2U2xo9YTOPQevHokJJlnY8S5Xt96LYeXybUHSQ+z1l8wAFTLsQi49OT33Ry0CptyfJnjO438iGIztNGRhfBAGEyATtbbtce9F2KOPg=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:32:53.412475 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-c8f2da35-87da-4692-b295-13b6fd1aff65 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Getting quotas for project 7bd6234b23704bdf809481085ce465eb. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:32:53.421319 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-c8f2da35-87da-4692-b295-13b6fd1aff65 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Getting quotas for user 308c01bc66224188aec055c2397a066b and project 7bd6234b23704bdf809481085ce465eb. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:32:53.475841 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c8f2da35-87da-4692-b295-13b6fd1aff65 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.103546 Oct 17 04:32:53.478014 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 117/225] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Oct 17 04:32:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:32:53.757417 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-704f881f-2bc5-4635-b329-551239fdb850 req-23fb3a62-bc4b-4b19-ba1e-e56e241c18b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39992be4-54ec-43d5-860c-c04e357acb5c", "tag": "cc1c6c63-3811-490e-b34f-4b6b771f6c42"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:32:53.798944 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-704f881f-2bc5-4635-b329-551239fdb850 req-23fb3a62-bc4b-4b19-ba1e-e56e241c18b0 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:53.799891 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-704f881f-2bc5-4635-b329-551239fdb850 req-23fb3a62-bc4b-4b19-ba1e-e56e241c18b0 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:53.806527 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-704f881f-2bc5-4635-b329-551239fdb850 req-23fb3a62-bc4b-4b19-ba1e-e56e241c18b0 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:53.810695 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7c9cd4e0-c11d-4ac6-b30f-010625255b97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:53.811333 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7c9cd4e0-c11d-4ac6-b30f-010625255b97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:53.827313 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-704f881f-2bc5-4635-b329-551239fdb850 req-23fb3a62-bc4b-4b19-ba1e-e56e241c18b0 service nova] Creating event network-changed:cc1c6c63-3811-490e-b34f-4b6b771f6c42 for instance 39992be4-54ec-43d5-860c-c04e357acb5c on hv-cinder-86155 Oct 17 04:32:53.832787 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-704f881f-2bc5-4635-b329-551239fdb850 req-23fb3a62-bc4b-4b19-ba1e-e56e241c18b0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082440 Oct 17 04:32:53.833803 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 109/226] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:32:53.834260 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c9cd4e0-c11d-4ac6-b30f-010625255b97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:53.834866 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c9cd4e0-c11d-4ac6-b30f-010625255b97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:53.835314 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c9cd4e0-c11d-4ac6-b30f-010625255b97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:53.836128 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c9cd4e0-c11d-4ac6-b30f-010625255b97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:53.837710 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c9cd4e0-c11d-4ac6-b30f-010625255b97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:53.838150 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c9cd4e0-c11d-4ac6-b30f-010625255b97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:54.209665 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-7c9cd4e0-c11d-4ac6-b30f-010625255b97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:54.219251 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7c9cd4e0-c11d-4ac6-b30f-010625255b97 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1313 microversion: 2.1 time: 0.414449 Oct 17 04:32:54.227388 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 118/227] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:53 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:55.249543 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5501b7a3-6ea8-40e4-b7fa-cab267d06cb2 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:55.251123 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5501b7a3-6ea8-40e4-b7fa-cab267d06cb2 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:55.265021 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5501b7a3-6ea8-40e4-b7fa-cab267d06cb2 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:55.267105 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5501b7a3-6ea8-40e4-b7fa-cab267d06cb2 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:55.268293 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5501b7a3-6ea8-40e4-b7fa-cab267d06cb2 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:55.269368 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5501b7a3-6ea8-40e4-b7fa-cab267d06cb2 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:55.273437 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5501b7a3-6ea8-40e4-b7fa-cab267d06cb2 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:55.274297 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5501b7a3-6ea8-40e4-b7fa-cab267d06cb2 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:55.525695 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-5501b7a3-6ea8-40e4-b7fa-cab267d06cb2 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:55.535385 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5501b7a3-6ea8-40e4-b7fa-cab267d06cb2 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1313 microversion: 2.1 time: 0.291216 Oct 17 04:32:55.545588 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 110/228] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:55 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:56.421176 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6c200f07-86f7-423d-8ded-c2d8372ef28c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2005260841", "imageRef": "bf655d8c-fb2f-42ef-a7a7-0386f57b58cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ce7fcf6-47cd-4a5b-9f10-a91cb1036deb"}], "security_groups": [{"name": "tempest-securitygroup--196461553"}], "key_name": "tempest-keypair-1239879014", "user_data": "}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:32:56.562879 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4666fea9-6471-4f59-8f63-fc3fc7db4602 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:56.562879 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4666fea9-6471-4f59-8f63-fc3fc7db4602 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:56.567673 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4666fea9-6471-4f59-8f63-fc3fc7db4602 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:56.568971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4666fea9-6471-4f59-8f63-fc3fc7db4602 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:56.569498 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4666fea9-6471-4f59-8f63-fc3fc7db4602 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:56.570256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4666fea9-6471-4f59-8f63-fc3fc7db4602 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:56.570699 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4666fea9-6471-4f59-8f63-fc3fc7db4602 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:56.571295 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4666fea9-6471-4f59-8f63-fc3fc7db4602 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:56.637571 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-6c200f07-86f7-423d-8ded-c2d8372ef28c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] validate_networks() for [('4ce7fcf6-47cd-4a5b-9f10-a91cb1036deb', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:32:56.860933 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-4666fea9-6471-4f59-8f63-fc3fc7db4602 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:56.871917 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4666fea9-6471-4f59-8f63-fc3fc7db4602 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1313 microversion: 2.1 time: 0.315976 Oct 17 04:32:56.872850 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 111/229] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:56 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:32:57.271726 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6c200f07-86f7-423d-8ded-c2d8372ef28c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:32:57.272253 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6c200f07-86f7-423d-8ded-c2d8372ef28c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:32:57.272791 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6c200f07-86f7-423d-8ded-c2d8372ef28c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:32:57.273490 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6c200f07-86f7-423d-8ded-c2d8372ef28c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:32:57.274596 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-6c200f07-86f7-423d-8ded-c2d8372ef28c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:32:57.296115 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c200f07-86f7-423d-8ded-c2d8372ef28c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:57.296603 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c200f07-86f7-423d-8ded-c2d8372ef28c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:57.297042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c200f07-86f7-423d-8ded-c2d8372ef28c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:57.297795 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c200f07-86f7-423d-8ded-c2d8372ef28c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:57.298248 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c200f07-86f7-423d-8ded-c2d8372ef28c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:57.304319 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c200f07-86f7-423d-8ded-c2d8372ef28c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:57.344330 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-6c200f07-86f7-423d-8ded-c2d8372ef28c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Getting quotas for project 7bd6234b23704bdf809481085ce465eb. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:32:57.351926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-6c200f07-86f7-423d-8ded-c2d8372ef28c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Getting quotas for user 308c01bc66224188aec055c2397a066b and project 7bd6234b23704bdf809481085ce465eb. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:32:57.372576 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6c200f07-86f7-423d-8ded-c2d8372ef28c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:32:57.375642 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6c200f07-86f7-423d-8ded-c2d8372ef28c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf655d8c-fb2f-42ef-a7a7-0386f57b58cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:32:57.427741 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:32:57.463868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6c200f07-86f7-423d-8ded-c2d8372ef28c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.051133 Oct 17 04:32:57.465434 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 119/230] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:32:56 2022] POST /compute/v2.1/servers => generated 408 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 04:32:57.477454 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-33dbb28a-5590-4eb7-8414-42abd1591439 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:57.478147 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-33dbb28a-5590-4eb7-8414-42abd1591439 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:57.626074 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-33dbb28a-5590-4eb7-8414-42abd1591439 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:57.634131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-33dbb28a-5590-4eb7-8414-42abd1591439 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1246 microversion: 2.1 time: 0.161693 Oct 17 04:32:57.651859 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 112/231] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:57 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1246 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:57.899484 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dc247130-26bf-4549-8f29-d308942f0616 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:57.901110 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dc247130-26bf-4549-8f29-d308942f0616 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:57.913595 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc247130-26bf-4549-8f29-d308942f0616 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:57.923912 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc247130-26bf-4549-8f29-d308942f0616 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:57.924748 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc247130-26bf-4549-8f29-d308942f0616 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:57.925413 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc247130-26bf-4549-8f29-d308942f0616 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:57.929581 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc247130-26bf-4549-8f29-d308942f0616 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:57.930588 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc247130-26bf-4549-8f29-d308942f0616 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:58.146025 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-dc247130-26bf-4549-8f29-d308942f0616 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:58.155037 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dc247130-26bf-4549-8f29-d308942f0616 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1313 microversion: 2.1 time: 0.262174 Oct 17 04:32:58.156221 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 120/232] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:57 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:58.376020 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-965ee134-88eb-4b60-9fdb-bd8ffa114b02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:58.376874 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-965ee134-88eb-4b60-9fdb-bd8ffa114b02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:58.386360 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:32:58.388252 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-965ee134-88eb-4b60-9fdb-bd8ffa114b02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:58.397888 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-965ee134-88eb-4b60-9fdb-bd8ffa114b02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:58.398695 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-965ee134-88eb-4b60-9fdb-bd8ffa114b02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:58.399682 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-965ee134-88eb-4b60-9fdb-bd8ffa114b02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:58.400438 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-965ee134-88eb-4b60-9fdb-bd8ffa114b02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:58.401803 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-965ee134-88eb-4b60-9fdb-bd8ffa114b02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:58.461655 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-965ee134-88eb-4b60-9fdb-bd8ffa114b02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d/ips" status: 200 len: 150 microversion: 2.20 time: 0.079358 Oct 17 04:32:58.462862 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 113/233] 10.222.0.40 () {60 vars in 1289 bytes} [Mon Oct 17 04:32:58 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d/ips => generated 150 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 04:32:58.659942 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d61e42d4-ec9f-490b-9dc9-880cbc54de6f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:58.660531 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d61e42d4-ec9f-490b-9dc9-880cbc54de6f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:58.672396 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d61e42d4-ec9f-490b-9dc9-880cbc54de6f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:58.673384 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d61e42d4-ec9f-490b-9dc9-880cbc54de6f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:58.673985 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d61e42d4-ec9f-490b-9dc9-880cbc54de6f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:58.674887 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d61e42d4-ec9f-490b-9dc9-880cbc54de6f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:58.675497 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d61e42d4-ec9f-490b-9dc9-880cbc54de6f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:58.676628 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d61e42d4-ec9f-490b-9dc9-880cbc54de6f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:58.801234 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-d61e42d4-ec9f-490b-9dc9-880cbc54de6f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:58.812106 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d61e42d4-ec9f-490b-9dc9-880cbc54de6f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1298 microversion: 2.1 time: 0.156260 Oct 17 04:32:58.812985 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 121/234] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:58 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1298 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:59.008291 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a035b46f-f26a-4e18-a93f-f6f442d0a014 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:59.008989 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a035b46f-f26a-4e18-a93f-f6f442d0a014 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:59.018841 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a035b46f-f26a-4e18-a93f-f6f442d0a014 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:59.021595 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a035b46f-f26a-4e18-a93f-f6f442d0a014 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:59.022343 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a035b46f-f26a-4e18-a93f-f6f442d0a014 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:59.023400 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a035b46f-f26a-4e18-a93f-f6f442d0a014 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:59.025227 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a035b46f-f26a-4e18-a93f-f6f442d0a014 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:59.028169 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a035b46f-f26a-4e18-a93f-f6f442d0a014 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:59.078751 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a035b46f-f26a-4e18-a93f-f6f442d0a014 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369/ips" status: 200 len: 150 microversion: 2.1 time: 0.074644 Oct 17 04:32:59.083480 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 114/235] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Oct 17 04:32:59 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369/ips => generated 150 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:32:59.187924 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-50422caa-632f-40f5-91e4-79e4d078a516 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:59.190780 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-50422caa-632f-40f5-91e4-79e4d078a516 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:59.229696 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50422caa-632f-40f5-91e4-79e4d078a516 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:59.232093 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50422caa-632f-40f5-91e4-79e4d078a516 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:59.232567 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50422caa-632f-40f5-91e4-79e4d078a516 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:59.235729 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50422caa-632f-40f5-91e4-79e4d078a516 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:59.236401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50422caa-632f-40f5-91e4-79e4d078a516 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:59.236994 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-50422caa-632f-40f5-91e4-79e4d078a516 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:59.751862 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-50422caa-632f-40f5-91e4-79e4d078a516 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:32:59.767977 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-50422caa-632f-40f5-91e4-79e4d078a516 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1313 microversion: 2.1 time: 0.589302 Oct 17 04:32:59.772069 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 122/236] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:59 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1313 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:32:59.841168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d4589d5c-115f-435b-8bb9-0880e0a8b397 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:32:59.841706 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d4589d5c-115f-435b-8bb9-0880e0a8b397 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:32:59.859429 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4589d5c-115f-435b-8bb9-0880e0a8b397 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:59.859953 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4589d5c-115f-435b-8bb9-0880e0a8b397 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:59.864864 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4589d5c-115f-435b-8bb9-0880e0a8b397 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:32:59.866613 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4589d5c-115f-435b-8bb9-0880e0a8b397 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:32:59.870833 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4589d5c-115f-435b-8bb9-0880e0a8b397 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:32:59.871607 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4589d5c-115f-435b-8bb9-0880e0a8b397 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:00.194658 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d4589d5c-115f-435b-8bb9-0880e0a8b397 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:00.226245 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d4589d5c-115f-435b-8bb9-0880e0a8b397 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1304 microversion: 2.1 time: 0.390478 Oct 17 04:33:00.231674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 115/237] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:32:59 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1304 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:00.799088 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fae3fc5c-e811-4748-9f46-7951fd2e001f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:00.799912 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fae3fc5c-e811-4748-9f46-7951fd2e001f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:00.809177 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fae3fc5c-e811-4748-9f46-7951fd2e001f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:00.810026 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fae3fc5c-e811-4748-9f46-7951fd2e001f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:00.810683 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fae3fc5c-e811-4748-9f46-7951fd2e001f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:00.811887 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fae3fc5c-e811-4748-9f46-7951fd2e001f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:00.812576 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fae3fc5c-e811-4748-9f46-7951fd2e001f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:00.813346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fae3fc5c-e811-4748-9f46-7951fd2e001f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:00.998030 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-313ded46-ea54-4cca-8bfa-45742b745821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:00.998585 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-313ded46-ea54-4cca-8bfa-45742b745821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:01.006539 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-313ded46-ea54-4cca-8bfa-45742b745821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:01.007030 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-313ded46-ea54-4cca-8bfa-45742b745821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:01.007472 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-313ded46-ea54-4cca-8bfa-45742b745821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:01.008364 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-313ded46-ea54-4cca-8bfa-45742b745821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:01.008978 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-313ded46-ea54-4cca-8bfa-45742b745821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:01.009575 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-313ded46-ea54-4cca-8bfa-45742b745821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:01.054931 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-313ded46-ea54-4cca-8bfa-45742b745821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lazy-loading 'flavor' on Instance uuid ee04d43c-6d11-4571-989e-90ee8175e03d {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:33:01.231251 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-fae3fc5c-e811-4748-9f46-7951fd2e001f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:01.255674 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fae3fc5c-e811-4748-9f46-7951fd2e001f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1313 microversion: 2.1 time: 0.464278 Oct 17 04:33:01.270154 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 123/238] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:00 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:01.275682 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1aad5b05-579d-40cf-a350-88eda53a27d4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea058293-ae48-45f4-b2da-73f9230fdef1"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:01.278238 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1aad5b05-579d-40cf-a350-88eda53a27d4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:01.290309 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1aad5b05-579d-40cf-a350-88eda53a27d4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:01.290804 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1aad5b05-579d-40cf-a350-88eda53a27d4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:01.291247 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1aad5b05-579d-40cf-a350-88eda53a27d4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:01.292702 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1aad5b05-579d-40cf-a350-88eda53a27d4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:01.293190 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1aad5b05-579d-40cf-a350-88eda53a27d4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:01.293619 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1aad5b05-579d-40cf-a350-88eda53a27d4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:01.412265 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-313ded46-ea54-4cca-8bfa-45742b745821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "POST /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d/action" status: 202 len: 0 microversion: 2.20 time: 0.418855 Oct 17 04:33:01.412923 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 116/239] 10.222.0.40 () {62 vars in 1319 bytes} [Mon Oct 17 04:33:00 2022] POST /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 04:33:01.437766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dc19fbce-12eb-45fc-835b-cb92a60982b7 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:01.438861 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dc19fbce-12eb-45fc-835b-cb92a60982b7 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:01.483802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc19fbce-12eb-45fc-835b-cb92a60982b7 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:01.486071 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc19fbce-12eb-45fc-835b-cb92a60982b7 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:01.486724 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc19fbce-12eb-45fc-835b-cb92a60982b7 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:01.488052 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc19fbce-12eb-45fc-835b-cb92a60982b7 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:01.488667 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc19fbce-12eb-45fc-835b-cb92a60982b7 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:01.489351 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc19fbce-12eb-45fc-835b-cb92a60982b7 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:01.673258 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-dc19fbce-12eb-45fc-835b-cb92a60982b7 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:01.680231 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:01.685291 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dc19fbce-12eb-45fc-835b-cb92a60982b7 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1304 microversion: 2.1 time: 0.263850 Oct 17 04:33:01.685877 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 117/240] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:01 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1304 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:01.701433 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-534cc186-43e5-4b34-afc0-3dd3a9f124a2 req-1721c26b-17cb-49d7-9677-1819b6cec557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39992be4-54ec-43d5-860c-c04e357acb5c", "name": "network-vif-plugged", "status": "completed", "tag": "cc1c6c63-3811-490e-b34f-4b6b771f6c42"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:01.719048 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-534cc186-43e5-4b34-afc0-3dd3a9f124a2 req-1721c26b-17cb-49d7-9677-1819b6cec557 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:01.719528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-534cc186-43e5-4b34-afc0-3dd3a9f124a2 req-1721c26b-17cb-49d7-9677-1819b6cec557 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:01.720131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-534cc186-43e5-4b34-afc0-3dd3a9f124a2 req-1721c26b-17cb-49d7-9677-1819b6cec557 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:01.737293 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-534cc186-43e5-4b34-afc0-3dd3a9f124a2 req-1721c26b-17cb-49d7-9677-1819b6cec557 service nova] Creating event network-vif-plugged:cc1c6c63-3811-490e-b34f-4b6b771f6c42 for instance 39992be4-54ec-43d5-860c-c04e357acb5c on hv-cinder-86155 Oct 17 04:33:01.748219 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-534cc186-43e5-4b34-afc0-3dd3a9f124a2 req-1721c26b-17cb-49d7-9677-1819b6cec557 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057730 Oct 17 04:33:01.749352 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 118/241] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:33:01.758673 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-12aeae10-e146-41cf-b6b9-0fa5dd5b9a6c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:01.763712 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-12aeae10-e146-41cf-b6b9-0fa5dd5b9a6c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:01.800489 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12aeae10-e146-41cf-b6b9-0fa5dd5b9a6c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:01.801466 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12aeae10-e146-41cf-b6b9-0fa5dd5b9a6c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:01.819282 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12aeae10-e146-41cf-b6b9-0fa5dd5b9a6c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:01.820557 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12aeae10-e146-41cf-b6b9-0fa5dd5b9a6c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:01.822427 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12aeae10-e146-41cf-b6b9-0fa5dd5b9a6c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:01.826402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-12aeae10-e146-41cf-b6b9-0fa5dd5b9a6c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:01.970916 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1aad5b05-579d-40cf-a350-88eda53a27d4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "POST /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699358 Oct 17 04:33:01.972800 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 124/242] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Oct 17 04:33:01 2022] POST /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369/os-volume_attachments => generated 194 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:33:02.282629 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-448c2911-8437-4797-94c2-22e07d71bb78 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:02.283396 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-448c2911-8437-4797-94c2-22e07d71bb78 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:02.301535 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-448c2911-8437-4797-94c2-22e07d71bb78 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:02.302472 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-448c2911-8437-4797-94c2-22e07d71bb78 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:02.304140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-448c2911-8437-4797-94c2-22e07d71bb78 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:02.308220 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-448c2911-8437-4797-94c2-22e07d71bb78 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:02.308425 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-448c2911-8437-4797-94c2-22e07d71bb78 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:02.311359 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-448c2911-8437-4797-94c2-22e07d71bb78 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:02.595434 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-12aeae10-e146-41cf-b6b9-0fa5dd5b9a6c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:02.608529 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-12aeae10-e146-41cf-b6b9-0fa5dd5b9a6c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:02.617652 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-12aeae10-e146-41cf-b6b9-0fa5dd5b9a6c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:02.618889 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-12aeae10-e146-41cf-b6b9-0fa5dd5b9a6c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1722 microversion: 2.20 time: 0.868273 Oct 17 04:33:02.622503 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 119/243] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:01 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1722 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:02.716769 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e35c3b31-1d36-4f51-b5ae-7c1250bb8845 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:02.717766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e35c3b31-1d36-4f51-b5ae-7c1250bb8845 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:02.735334 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e35c3b31-1d36-4f51-b5ae-7c1250bb8845 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:02.738879 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e35c3b31-1d36-4f51-b5ae-7c1250bb8845 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:02.739554 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e35c3b31-1d36-4f51-b5ae-7c1250bb8845 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:02.742137 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e35c3b31-1d36-4f51-b5ae-7c1250bb8845 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:02.747072 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e35c3b31-1d36-4f51-b5ae-7c1250bb8845 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:02.748515 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e35c3b31-1d36-4f51-b5ae-7c1250bb8845 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:02.800077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-448c2911-8437-4797-94c2-22e07d71bb78 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:02.810590 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-448c2911-8437-4797-94c2-22e07d71bb78 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1313 microversion: 2.1 time: 0.533076 Oct 17 04:33:02.811810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 125/244] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:02 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1313 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:02.993326 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e35c3b31-1d36-4f51-b5ae-7c1250bb8845 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:03.009174 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e35c3b31-1d36-4f51-b5ae-7c1250bb8845 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1371 microversion: 2.1 time: 0.296261 Oct 17 04:33:03.010107 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 120/245] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:02 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1371 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:33:03.652247 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a56860bf-0179-4701-b560-b1457249be4f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:03.652993 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a56860bf-0179-4701-b560-b1457249be4f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:03.660148 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a56860bf-0179-4701-b560-b1457249be4f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:03.660644 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a56860bf-0179-4701-b560-b1457249be4f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:03.661152 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a56860bf-0179-4701-b560-b1457249be4f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:03.661819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a56860bf-0179-4701-b560-b1457249be4f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:03.662275 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a56860bf-0179-4701-b560-b1457249be4f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:03.662704 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a56860bf-0179-4701-b560-b1457249be4f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:03.838853 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-46ded046-2192-40c2-b138-33798b50487f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:03.840185 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-46ded046-2192-40c2-b138-33798b50487f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:03.859092 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46ded046-2192-40c2-b138-33798b50487f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:03.861411 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46ded046-2192-40c2-b138-33798b50487f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:03.862738 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46ded046-2192-40c2-b138-33798b50487f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:03.866210 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46ded046-2192-40c2-b138-33798b50487f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:03.866694 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46ded046-2192-40c2-b138-33798b50487f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:03.867128 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46ded046-2192-40c2-b138-33798b50487f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:04.255219 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a56860bf-0179-4701-b560-b1457249be4f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:04.269596 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a56860bf-0179-4701-b560-b1457249be4f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:04.271687 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a56860bf-0179-4701-b560-b1457249be4f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:04.278826 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a56860bf-0179-4701-b560-b1457249be4f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1722 microversion: 2.20 time: 0.626126 Oct 17 04:33:04.293730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 126/246] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:03 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1722 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:04.297325 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-46ded046-2192-40c2-b138-33798b50487f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:04.302825 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-27e00495-5e27-4018-825c-483445899ad0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:04.305899 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-27e00495-5e27-4018-825c-483445899ad0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:04.309685 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-46ded046-2192-40c2-b138-33798b50487f tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1313 microversion: 2.1 time: 0.476426 Oct 17 04:33:04.321601 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27e00495-5e27-4018-825c-483445899ad0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:04.321601 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27e00495-5e27-4018-825c-483445899ad0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:04.321601 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27e00495-5e27-4018-825c-483445899ad0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:04.321601 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27e00495-5e27-4018-825c-483445899ad0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:04.321989 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27e00495-5e27-4018-825c-483445899ad0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:04.321989 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-27e00495-5e27-4018-825c-483445899ad0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:04.330039 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:04.333002 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 121/247] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:03 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1313 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:04.606805 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-27e00495-5e27-4018-825c-483445899ad0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:04.618839 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-27e00495-5e27-4018-825c-483445899ad0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1371 microversion: 2.1 time: 0.323850 Oct 17 04:33:04.619430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 127/248] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:04 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1371 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:04.844555 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e77e3cbd-48c5-4165-95f1-19e52a31490b req-0117559e-4fe0-433a-ba49-071ee7277289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5722cf2-3e88-4c8e-a533-e6a228c13a82", "tag": "d6e73103-0bcc-46c6-a3be-e7d793fb4195"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:04.871447 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e77e3cbd-48c5-4165-95f1-19e52a31490b req-0117559e-4fe0-433a-ba49-071ee7277289 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:04.871998 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e77e3cbd-48c5-4165-95f1-19e52a31490b req-0117559e-4fe0-433a-ba49-071ee7277289 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:04.873239 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e77e3cbd-48c5-4165-95f1-19e52a31490b req-0117559e-4fe0-433a-ba49-071ee7277289 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:04.893707 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e77e3cbd-48c5-4165-95f1-19e52a31490b req-0117559e-4fe0-433a-ba49-071ee7277289 service nova] Creating event network-changed:d6e73103-0bcc-46c6-a3be-e7d793fb4195 for instance e5722cf2-3e88-4c8e-a533-e6a228c13a82 on hv-cinder-86155 Oct 17 04:33:04.900708 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e77e3cbd-48c5-4165-95f1-19e52a31490b req-0117559e-4fe0-433a-ba49-071ee7277289 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060573 Oct 17 04:33:04.902352 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 122/249] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:33:05.311587 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cc5b24b4-3f88-46eb-8111-e2ed0ae85da5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:05.312839 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cc5b24b4-3f88-46eb-8111-e2ed0ae85da5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:05.321874 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cc5b24b4-3f88-46eb-8111-e2ed0ae85da5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:05.322371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cc5b24b4-3f88-46eb-8111-e2ed0ae85da5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:05.323437 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cc5b24b4-3f88-46eb-8111-e2ed0ae85da5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:05.324228 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cc5b24b4-3f88-46eb-8111-e2ed0ae85da5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:05.324622 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cc5b24b4-3f88-46eb-8111-e2ed0ae85da5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:05.325042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cc5b24b4-3f88-46eb-8111-e2ed0ae85da5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:05.646027 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ad4c60f1-eee7-4952-83ac-3e6db0dc9397 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Action: 'create', calling method: .version_select at 0x7fc630f64af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1420702188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoRV6nMpRiaCyLdjp7A1HPfdunkoMOKZ8LpCRDuBRvLkPqsSTdCPBCVsiZQACPk5ogrhTsfFILFtSsFRBFisL9gNbt7d30zghMXZ7gsjBVWli32N6+7nN8F85j8KYqXVg=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:05.657658 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:05.683573 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-ad4c60f1-eee7-4952-83ac-3e6db0dc9397 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Getting quotas for project 164c660f217f4b29b914caf14b773b61. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:33:05.691552 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-ad4c60f1-eee7-4952-83ac-3e6db0dc9397 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Getting quotas for user f5d133f6649d4f8b9318b19d1d748f6f and project 164c660f217f4b29b914caf14b773b61. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:33:05.723025 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ad4c60f1-eee7-4952-83ac-3e6db0dc9397 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.415555 Oct 17 04:33:05.730226 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 123/250] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Oct 17 04:33:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:33:05.747457 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0b64882b-3654-4f09-befa-91810b160726 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:05.748618 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0b64882b-3654-4f09-befa-91810b160726 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:05.775328 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b64882b-3654-4f09-befa-91810b160726 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:05.775863 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b64882b-3654-4f09-befa-91810b160726 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:05.776379 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b64882b-3654-4f09-befa-91810b160726 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:05.777166 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b64882b-3654-4f09-befa-91810b160726 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:05.777629 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b64882b-3654-4f09-befa-91810b160726 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:05.778268 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b64882b-3654-4f09-befa-91810b160726 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:06.012348 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-cc5b24b4-3f88-46eb-8111-e2ed0ae85da5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:06.027070 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-cc5b24b4-3f88-46eb-8111-e2ed0ae85da5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:06.036069 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-cc5b24b4-3f88-46eb-8111-e2ed0ae85da5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:06.040564 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cc5b24b4-3f88-46eb-8111-e2ed0ae85da5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1722 microversion: 2.20 time: 0.732256 Oct 17 04:33:06.044380 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 128/251] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:05 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1722 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:06.054916 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-52a52043-7cc6-43d5-902e-b73962e15504 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:06.055857 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-52a52043-7cc6-43d5-902e-b73962e15504 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:06.075504 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52a52043-7cc6-43d5-902e-b73962e15504 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:06.077883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52a52043-7cc6-43d5-902e-b73962e15504 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:06.078560 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52a52043-7cc6-43d5-902e-b73962e15504 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:06.080130 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52a52043-7cc6-43d5-902e-b73962e15504 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:06.083356 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52a52043-7cc6-43d5-902e-b73962e15504 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:06.083836 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52a52043-7cc6-43d5-902e-b73962e15504 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:06.321366 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-0b64882b-3654-4f09-befa-91810b160726 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:06.335826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0b64882b-3654-4f09-befa-91810b160726 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1496 microversion: 2.1 time: 0.603972 Oct 17 04:33:06.337463 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 124/252] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:05 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1496 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:06.452545 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-52a52043-7cc6-43d5-902e-b73962e15504 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:06.467864 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-52a52043-7cc6-43d5-902e-b73962e15504 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1371 microversion: 2.1 time: 0.421779 Oct 17 04:33:06.505330 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 129/253] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:06 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1371 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:07.074225 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a852053b-128a-49b2-9b5a-44f1680e9668 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:07.074960 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a852053b-128a-49b2-9b5a-44f1680e9668 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:07.082641 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a852053b-128a-49b2-9b5a-44f1680e9668 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:07.083221 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a852053b-128a-49b2-9b5a-44f1680e9668 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:07.083746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a852053b-128a-49b2-9b5a-44f1680e9668 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:07.084512 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a852053b-128a-49b2-9b5a-44f1680e9668 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:07.085165 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a852053b-128a-49b2-9b5a-44f1680e9668 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:07.085716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a852053b-128a-49b2-9b5a-44f1680e9668 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:07.304979 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-a852053b-128a-49b2-9b5a-44f1680e9668 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:07.317670 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ad32141c-d9b7-487f-adcd-dc0ed819c56e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:07.319208 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ad32141c-d9b7-487f-adcd-dc0ed819c56e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:07.322514 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-a852053b-128a-49b2-9b5a-44f1680e9668 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:07.324800 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-a852053b-128a-49b2-9b5a-44f1680e9668 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:07.326119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a852053b-128a-49b2-9b5a-44f1680e9668 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1722 microversion: 2.20 time: 0.257725 Oct 17 04:33:07.327453 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 125/254] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:07 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:07.340206 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:07.368864 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad32141c-d9b7-487f-adcd-dc0ed819c56e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:07.369414 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad32141c-d9b7-487f-adcd-dc0ed819c56e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:07.371167 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad32141c-d9b7-487f-adcd-dc0ed819c56e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:07.372971 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad32141c-d9b7-487f-adcd-dc0ed819c56e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:07.374963 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad32141c-d9b7-487f-adcd-dc0ed819c56e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:07.375774 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ad32141c-d9b7-487f-adcd-dc0ed819c56e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:07.377779 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=10 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:07.414197 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ad32141c-d9b7-487f-adcd-dc0ed819c56e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:33:07.497438 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-209db075-e25b-4454-8628-00ad79355d1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:07.499459 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-209db075-e25b-4454-8628-00ad79355d1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:07.515027 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-209db075-e25b-4454-8628-00ad79355d1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:07.515677 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-209db075-e25b-4454-8628-00ad79355d1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:07.515929 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-209db075-e25b-4454-8628-00ad79355d1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:07.517044 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-209db075-e25b-4454-8628-00ad79355d1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:07.518004 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-209db075-e25b-4454-8628-00ad79355d1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:07.518829 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-209db075-e25b-4454-8628-00ad79355d1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:07.575625 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ad32141c-d9b7-487f-adcd-dc0ed819c56e tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "DELETE /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 204 len: 0 microversion: 2.1 time: 0.264752 Oct 17 04:33:07.577039 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 130/255] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:33:07 2022] DELETE /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:33:07.588785 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2f0ed680-e568-4272-9183-5025e292aabd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:07.591362 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2f0ed680-e568-4272-9183-5025e292aabd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:07.617713 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f0ed680-e568-4272-9183-5025e292aabd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:07.618247 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f0ed680-e568-4272-9183-5025e292aabd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:07.618749 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f0ed680-e568-4272-9183-5025e292aabd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:07.620776 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f0ed680-e568-4272-9183-5025e292aabd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:07.621468 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f0ed680-e568-4272-9183-5025e292aabd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:07.622051 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f0ed680-e568-4272-9183-5025e292aabd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:07.934500 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-2f0ed680-e568-4272-9183-5025e292aabd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:07.971435 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2f0ed680-e568-4272-9183-5025e292aabd tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1502 microversion: 2.1 time: 0.388907 Oct 17 04:33:07.972028 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 131/256] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:07 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1502 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:08.033589 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-209db075-e25b-4454-8628-00ad79355d1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:08.043841 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-209db075-e25b-4454-8628-00ad79355d1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1371 microversion: 2.1 time: 0.554941 Oct 17 04:33:08.044842 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 126/257] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:07 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1371 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:08.373355 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e7dec70f-d9b7-4567-9d19-ddae5930c02b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:08.374323 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e7dec70f-d9b7-4567-9d19-ddae5930c02b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:08.380564 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7dec70f-d9b7-4567-9d19-ddae5930c02b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:08.381299 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7dec70f-d9b7-4567-9d19-ddae5930c02b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:08.381733 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7dec70f-d9b7-4567-9d19-ddae5930c02b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:08.382738 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7dec70f-d9b7-4567-9d19-ddae5930c02b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:08.383537 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7dec70f-d9b7-4567-9d19-ddae5930c02b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:08.383966 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7dec70f-d9b7-4567-9d19-ddae5930c02b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:08.530702 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e7dec70f-d9b7-4567-9d19-ddae5930c02b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:08.540569 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e7dec70f-d9b7-4567-9d19-ddae5930c02b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:08.542196 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e7dec70f-d9b7-4567-9d19-ddae5930c02b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:08.543417 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e7dec70f-d9b7-4567-9d19-ddae5930c02b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1722 microversion: 2.20 time: 0.175242 Oct 17 04:33:08.543980 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 132/258] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:08 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:08.997373 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-113cc414-a67b-4f7c-b335-8d117a5d702d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:08.998002 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-113cc414-a67b-4f7c-b335-8d117a5d702d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:09.004044 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-113cc414-a67b-4f7c-b335-8d117a5d702d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:09.004532 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-113cc414-a67b-4f7c-b335-8d117a5d702d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:09.004967 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-113cc414-a67b-4f7c-b335-8d117a5d702d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:09.006310 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-113cc414-a67b-4f7c-b335-8d117a5d702d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:09.006929 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-113cc414-a67b-4f7c-b335-8d117a5d702d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:09.007504 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-113cc414-a67b-4f7c-b335-8d117a5d702d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:09.067647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-196ed787-104e-4a65-8ba3-6e87cfb1dc24 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:09.068264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-196ed787-104e-4a65-8ba3-6e87cfb1dc24 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:09.076098 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-196ed787-104e-4a65-8ba3-6e87cfb1dc24 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:09.076586 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-196ed787-104e-4a65-8ba3-6e87cfb1dc24 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:09.077028 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-196ed787-104e-4a65-8ba3-6e87cfb1dc24 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:09.078055 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-196ed787-104e-4a65-8ba3-6e87cfb1dc24 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:09.078711 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-196ed787-104e-4a65-8ba3-6e87cfb1dc24 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:09.079307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-196ed787-104e-4a65-8ba3-6e87cfb1dc24 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:09.227099 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-113cc414-a67b-4f7c-b335-8d117a5d702d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:09.240599 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-113cc414-a67b-4f7c-b335-8d117a5d702d tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1502 microversion: 2.1 time: 0.246518 Oct 17 04:33:09.241216 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 127/259] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:08 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1502 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:33:09.300805 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-196ed787-104e-4a65-8ba3-6e87cfb1dc24 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:09.311084 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-196ed787-104e-4a65-8ba3-6e87cfb1dc24 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1371 microversion: 2.1 time: 0.247150 Oct 17 04:33:09.312006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 133/260] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:09 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:33:09.569705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-883e3bb9-72fc-49b5-bf7e-f8a2a8c2fb02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:09.571784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-883e3bb9-72fc-49b5-bf7e-f8a2a8c2fb02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:09.578301 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-883e3bb9-72fc-49b5-bf7e-f8a2a8c2fb02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:09.578796 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-883e3bb9-72fc-49b5-bf7e-f8a2a8c2fb02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:09.579228 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-883e3bb9-72fc-49b5-bf7e-f8a2a8c2fb02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:09.580083 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-883e3bb9-72fc-49b5-bf7e-f8a2a8c2fb02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:09.581754 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-883e3bb9-72fc-49b5-bf7e-f8a2a8c2fb02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:09.582344 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-883e3bb9-72fc-49b5-bf7e-f8a2a8c2fb02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:09.716789 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-883e3bb9-72fc-49b5-bf7e-f8a2a8c2fb02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:09.725339 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-883e3bb9-72fc-49b5-bf7e-f8a2a8c2fb02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:09.726717 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-883e3bb9-72fc-49b5-bf7e-f8a2a8c2fb02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:09.727870 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-883e3bb9-72fc-49b5-bf7e-f8a2a8c2fb02 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1722 microversion: 2.20 time: 0.162468 Oct 17 04:33:09.728429 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 128/261] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:09 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:09.897462 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-45b84be3-f99c-44de-a284-93a971e96fda tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:09.898005 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-45b84be3-f99c-44de-a284-93a971e96fda tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:09.905350 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45b84be3-f99c-44de-a284-93a971e96fda tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:09.905852 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45b84be3-f99c-44de-a284-93a971e96fda tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:09.906292 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45b84be3-f99c-44de-a284-93a971e96fda tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:09.907312 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45b84be3-f99c-44de-a284-93a971e96fda tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:09.907769 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45b84be3-f99c-44de-a284-93a971e96fda tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:09.908538 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-45b84be3-f99c-44de-a284-93a971e96fda tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:09.958308 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-45b84be3-f99c-44de-a284-93a971e96fda tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617/ips" status: 200 len: 145 microversion: 2.1 time: 0.064563 Oct 17 04:33:09.966447 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 134/262] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Oct 17 04:33:09 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617/ips => generated 145 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:33:10.264414 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d778e9d4-9e71-4df1-a324-df207a84cdbf tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:10.265037 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d778e9d4-9e71-4df1-a324-df207a84cdbf tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:10.270982 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d778e9d4-9e71-4df1-a324-df207a84cdbf tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:10.271397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d778e9d4-9e71-4df1-a324-df207a84cdbf tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:10.271835 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d778e9d4-9e71-4df1-a324-df207a84cdbf tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:10.272569 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d778e9d4-9e71-4df1-a324-df207a84cdbf tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:10.273027 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d778e9d4-9e71-4df1-a324-df207a84cdbf tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:10.273493 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d778e9d4-9e71-4df1-a324-df207a84cdbf tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:10.334979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-648d922e-e2de-4efc-ac14-92a7be1ab518 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:10.335595 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-648d922e-e2de-4efc-ac14-92a7be1ab518 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:10.343335 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-648d922e-e2de-4efc-ac14-92a7be1ab518 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:10.343831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-648d922e-e2de-4efc-ac14-92a7be1ab518 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:10.344455 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-648d922e-e2de-4efc-ac14-92a7be1ab518 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:10.345354 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-648d922e-e2de-4efc-ac14-92a7be1ab518 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:10.345816 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-648d922e-e2de-4efc-ac14-92a7be1ab518 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:10.346424 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-648d922e-e2de-4efc-ac14-92a7be1ab518 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:10.528445 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d778e9d4-9e71-4df1-a324-df207a84cdbf tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:10.553019 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d778e9d4-9e71-4df1-a324-df207a84cdbf tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1502 microversion: 2.1 time: 0.293008 Oct 17 04:33:10.553636 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 129/263] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:10 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1502 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:10.582754 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-648d922e-e2de-4efc-ac14-92a7be1ab518 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:10.592003 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-648d922e-e2de-4efc-ac14-92a7be1ab518 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1371 microversion: 2.1 time: 0.260935 Oct 17 04:33:10.592584 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 135/264] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:10 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:33:10.753649 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-45f3e1ef-274b-448c-8ce6-ec4362c21174 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:10.754608 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-45f3e1ef-274b-448c-8ce6-ec4362c21174 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:10.761771 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45f3e1ef-274b-448c-8ce6-ec4362c21174 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:10.762370 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45f3e1ef-274b-448c-8ce6-ec4362c21174 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:10.762816 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45f3e1ef-274b-448c-8ce6-ec4362c21174 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:10.763582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45f3e1ef-274b-448c-8ce6-ec4362c21174 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:10.764123 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45f3e1ef-274b-448c-8ce6-ec4362c21174 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:10.764736 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45f3e1ef-274b-448c-8ce6-ec4362c21174 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:10.924671 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-45f3e1ef-274b-448c-8ce6-ec4362c21174 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:10.940782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-45f3e1ef-274b-448c-8ce6-ec4362c21174 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:10.945125 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-45f3e1ef-274b-448c-8ce6-ec4362c21174 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:10.946468 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-45f3e1ef-274b-448c-8ce6-ec4362c21174 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1722 microversion: 2.20 time: 0.197572 Oct 17 04:33:10.962312 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 130/265] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:10 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:11.520658 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-86a88f86-6f8b-433f-9fe2-729c52f964f7 req-f05d0fb6-c6d9-45de-a84e-8400fde2a292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5722cf2-3e88-4c8e-a533-e6a228c13a82", "name": "network-vif-plugged", "status": "completed", "tag": "d6e73103-0bcc-46c6-a3be-e7d793fb4195"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:11.549798 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-86a88f86-6f8b-433f-9fe2-729c52f964f7 req-f05d0fb6-c6d9-45de-a84e-8400fde2a292 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:11.551390 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-86a88f86-6f8b-433f-9fe2-729c52f964f7 req-f05d0fb6-c6d9-45de-a84e-8400fde2a292 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:11.553549 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-86a88f86-6f8b-433f-9fe2-729c52f964f7 req-f05d0fb6-c6d9-45de-a84e-8400fde2a292 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:11.576336 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4f6a1a5e-a4fc-4ea5-bd5b-c8daf777fe63 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:11.578009 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4f6a1a5e-a4fc-4ea5-bd5b-c8daf777fe63 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:11.580654 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-86a88f86-6f8b-433f-9fe2-729c52f964f7 req-f05d0fb6-c6d9-45de-a84e-8400fde2a292 service nova] Creating event network-vif-plugged:d6e73103-0bcc-46c6-a3be-e7d793fb4195 for instance e5722cf2-3e88-4c8e-a533-e6a228c13a82 on hv-cinder-86155 Oct 17 04:33:11.593491 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f6a1a5e-a4fc-4ea5-bd5b-c8daf777fe63 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:11.598368 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-86a88f86-6f8b-433f-9fe2-729c52f964f7 req-f05d0fb6-c6d9-45de-a84e-8400fde2a292 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085560 Oct 17 04:33:11.599092 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f6a1a5e-a4fc-4ea5-bd5b-c8daf777fe63 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:11.600609 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f6a1a5e-a4fc-4ea5-bd5b-c8daf777fe63 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:11.603058 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f6a1a5e-a4fc-4ea5-bd5b-c8daf777fe63 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:11.605029 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f6a1a5e-a4fc-4ea5-bd5b-c8daf777fe63 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:11.606108 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f6a1a5e-a4fc-4ea5-bd5b-c8daf777fe63 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:11.618630 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 136/266] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:33:11.636647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e5eb0ff7-8272-4ad1-ae92-5dee5b02292f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:11.639039 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e5eb0ff7-8272-4ad1-ae92-5dee5b02292f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:11.658925 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5eb0ff7-8272-4ad1-ae92-5dee5b02292f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:11.660114 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5eb0ff7-8272-4ad1-ae92-5dee5b02292f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:11.661480 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5eb0ff7-8272-4ad1-ae92-5dee5b02292f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:11.669605 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5eb0ff7-8272-4ad1-ae92-5dee5b02292f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:11.670382 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5eb0ff7-8272-4ad1-ae92-5dee5b02292f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:11.671044 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5eb0ff7-8272-4ad1-ae92-5dee5b02292f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:11.821529 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-4f6a1a5e-a4fc-4ea5-bd5b-c8daf777fe63 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:11.839410 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4f6a1a5e-a4fc-4ea5-bd5b-c8daf777fe63 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1460 microversion: 2.1 time: 0.267199 Oct 17 04:33:11.840923 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 131/267] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:11 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1460 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:11.934291 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-ab37a71f-82bd-418b-a194-bf2df7c048be req-6d05c62a-6327-4230-a2b9-d7070ff1a4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39992be4-54ec-43d5-860c-c04e357acb5c", "name": "network-vif-deleted", "tag": "cc1c6c63-3811-490e-b34f-4b6b771f6c42"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:11.949491 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ab37a71f-82bd-418b-a194-bf2df7c048be req-6d05c62a-6327-4230-a2b9-d7070ff1a4c4 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:11.950302 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ab37a71f-82bd-418b-a194-bf2df7c048be req-6d05c62a-6327-4230-a2b9-d7070ff1a4c4 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:11.950941 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ab37a71f-82bd-418b-a194-bf2df7c048be req-6d05c62a-6327-4230-a2b9-d7070ff1a4c4 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:12.012846 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-ab37a71f-82bd-418b-a194-bf2df7c048be req-6d05c62a-6327-4230-a2b9-d7070ff1a4c4 service nova] Creating event network-vif-deleted:cc1c6c63-3811-490e-b34f-4b6b771f6c42 for instance 39992be4-54ec-43d5-860c-c04e357acb5c on hv-cinder-86155 Oct 17 04:33:12.019161 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-ab37a71f-82bd-418b-a194-bf2df7c048be req-6d05c62a-6327-4230-a2b9-d7070ff1a4c4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089786 Oct 17 04:33:12.021353 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 132/268] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:33:12.044972 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e77be6f9-1621-4178-ada1-4c620ac5489e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:12.045503 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e5eb0ff7-8272-4ad1-ae92-5dee5b02292f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:12.048375 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e77be6f9-1621-4178-ada1-4c620ac5489e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:12.054333 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e5eb0ff7-8272-4ad1-ae92-5dee5b02292f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1371 microversion: 2.1 time: 0.433799 Oct 17 04:33:12.062940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e77be6f9-1621-4178-ada1-4c620ac5489e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:12.063674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e77be6f9-1621-4178-ada1-4c620ac5489e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:12.067135 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e77be6f9-1621-4178-ada1-4c620ac5489e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:12.068613 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e77be6f9-1621-4178-ada1-4c620ac5489e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:12.071158 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e77be6f9-1621-4178-ada1-4c620ac5489e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:12.071797 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e77be6f9-1621-4178-ada1-4c620ac5489e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:12.079114 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 137/269] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:11 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1371 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:12.306005 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e77be6f9-1621-4178-ada1-4c620ac5489e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:12.318400 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e77be6f9-1621-4178-ada1-4c620ac5489e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:12.319960 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e77be6f9-1621-4178-ada1-4c620ac5489e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:12.330558 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e77be6f9-1621-4178-ada1-4c620ac5489e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1722 microversion: 2.20 time: 0.305151 Oct 17 04:33:12.331303 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 133/270] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:12 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:12.441948 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-308656a3-ca29-4bfa-be31-31c17f18c7b2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Action: 'create', calling method: .version_select at 0x7fc630f80a60>, body: {"keypair": {"name": "tempest-keypair-1893884471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAUeBWobhz8mQeSWx0xDEl+441YzmmxxBCGHvI6ZhPx9qwC+yBDaZtCRO65NURTiyC7ArUrss3FnKiFZN0s4cr35kUteGPYy9LGafMrJe7TQHCEZz0tdbM0j8qJqoE0hQ=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:12.459755 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-308656a3-ca29-4bfa-be31-31c17f18c7b2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Getting quotas for project e022e6125e85417881ce226db7a5c764. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:33:12.464121 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-308656a3-ca29-4bfa-be31-31c17f18c7b2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Getting quotas for user 59aa96241a8e4d9db6d255c38f618ca1 and project e022e6125e85417881ce226db7a5c764. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:33:12.487005 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-308656a3-ca29-4bfa-be31-31c17f18c7b2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049523 Oct 17 04:33:12.487599 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 138/271] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Oct 17 04:33:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:33:12.863316 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-756996bd-6954-47a7-9f3d-e234a2176d27 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:12.877782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-756996bd-6954-47a7-9f3d-e234a2176d27 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:12.887002 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-756996bd-6954-47a7-9f3d-e234a2176d27 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:12.888957 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-756996bd-6954-47a7-9f3d-e234a2176d27 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:12.890074 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-756996bd-6954-47a7-9f3d-e234a2176d27 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:12.891476 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-756996bd-6954-47a7-9f3d-e234a2176d27 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:12.892911 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-756996bd-6954-47a7-9f3d-e234a2176d27 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:12.893549 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-756996bd-6954-47a7-9f3d-e234a2176d27 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:12.948367 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-756996bd-6954-47a7-9f3d-e234a2176d27 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:12.949267 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-756996bd-6954-47a7-9f3d-e234a2176d27 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:12.949864 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-756996bd-6954-47a7-9f3d-e234a2176d27 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:12.950792 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-756996bd-6954-47a7-9f3d-e234a2176d27 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lazy-loading 'fault' on Instance uuid 39992be4-54ec-43d5-860c-c04e357acb5c {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:33:13.016643 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-756996bd-6954-47a7-9f3d-e234a2176d27 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:13.026546 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-756996bd-6954-47a7-9f3d-e234a2176d27 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1303 microversion: 2.1 time: 0.166121 Oct 17 04:33:13.028196 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 134/272] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:12 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1303 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:13.084166 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f8ec8a98-0408-402a-b375-e80483c3c37f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:13.084772 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f8ec8a98-0408-402a-b375-e80483c3c37f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:13.091687 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8ec8a98-0408-402a-b375-e80483c3c37f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:13.092162 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8ec8a98-0408-402a-b375-e80483c3c37f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:13.092796 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8ec8a98-0408-402a-b375-e80483c3c37f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:13.093511 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8ec8a98-0408-402a-b375-e80483c3c37f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:13.094100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8ec8a98-0408-402a-b375-e80483c3c37f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:13.094669 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8ec8a98-0408-402a-b375-e80483c3c37f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:13.265992 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f8ec8a98-0408-402a-b375-e80483c3c37f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:13.278751 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f8ec8a98-0408-402a-b375-e80483c3c37f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1371 microversion: 2.1 time: 0.198791 Oct 17 04:33:13.279346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 139/273] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:13 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:13.373434 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3365d7fb-9445-482a-865c-488ae4d4cc8e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:13.374058 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3365d7fb-9445-482a-865c-488ae4d4cc8e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:13.383849 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3365d7fb-9445-482a-865c-488ae4d4cc8e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:13.384346 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3365d7fb-9445-482a-865c-488ae4d4cc8e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:13.384783 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3365d7fb-9445-482a-865c-488ae4d4cc8e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:13.386120 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3365d7fb-9445-482a-865c-488ae4d4cc8e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:13.386584 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3365d7fb-9445-482a-865c-488ae4d4cc8e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:13.387011 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3365d7fb-9445-482a-865c-488ae4d4cc8e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:13.438840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a99780df-63e7-4d3d-95fb-90181a601e9d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c2ffc79-79e8-4164-b522-5c3947418079"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:13.441708 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a99780df-63e7-4d3d-95fb-90181a601e9d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:13.449190 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a99780df-63e7-4d3d-95fb-90181a601e9d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:13.461995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a99780df-63e7-4d3d-95fb-90181a601e9d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:13.463036 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a99780df-63e7-4d3d-95fb-90181a601e9d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:13.466130 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a99780df-63e7-4d3d-95fb-90181a601e9d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:13.467536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a99780df-63e7-4d3d-95fb-90181a601e9d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:13.468313 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a99780df-63e7-4d3d-95fb-90181a601e9d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:13.579669 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3365d7fb-9445-482a-865c-488ae4d4cc8e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:13.600497 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3365d7fb-9445-482a-865c-488ae4d4cc8e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:13.602693 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3365d7fb-9445-482a-865c-488ae4d4cc8e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:13.603974 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3365d7fb-9445-482a-865c-488ae4d4cc8e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1722 microversion: 2.20 time: 0.235402 Oct 17 04:33:13.604537 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 135/274] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:13 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:14.052596 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-34c6e720-5257-436e-b5b8-7c01e8b8ddd6 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:14.053262 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-34c6e720-5257-436e-b5b8-7c01e8b8ddd6 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:14.069161 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34c6e720-5257-436e-b5b8-7c01e8b8ddd6 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:14.069673 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34c6e720-5257-436e-b5b8-7c01e8b8ddd6 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:14.094043 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34c6e720-5257-436e-b5b8-7c01e8b8ddd6 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:14.096547 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34c6e720-5257-436e-b5b8-7c01e8b8ddd6 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:14.100330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34c6e720-5257-436e-b5b8-7c01e8b8ddd6 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:14.101137 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34c6e720-5257-436e-b5b8-7c01e8b8ddd6 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:14.158233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34c6e720-5257-436e-b5b8-7c01e8b8ddd6 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:14.159040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34c6e720-5257-436e-b5b8-7c01e8b8ddd6 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:14.159517 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34c6e720-5257-436e-b5b8-7c01e8b8ddd6 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:14.160049 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-34c6e720-5257-436e-b5b8-7c01e8b8ddd6 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lazy-loading 'fault' on Instance uuid 39992be4-54ec-43d5-860c-c04e357acb5c {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:33:14.243308 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-34c6e720-5257-436e-b5b8-7c01e8b8ddd6 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb7bee3a97e4312ba30451b4a5f980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d5aaa16da54ea19e9c982c50540377', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:14.249985 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:14.259676 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-34c6e720-5257-436e-b5b8-7c01e8b8ddd6 tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 200 len: 1303 microversion: 2.1 time: 0.212135 Oct 17 04:33:14.261664 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 136/275] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:14 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 1303 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:14.268962 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-782eeca1-aa24-49dd-ae46-c765555443e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-472489366", "imageRef": "bf655d8c-fb2f-42ef-a7a7-0386f57b58cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60b2c529-82f9-47ea-9951-24ba7b38ebc9"}], "security_groups": [{"name": "tempest-securitygroup--2064667445"}], "key_name": "tempest-keypair-1893884471", "user_data": "}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:14.437246 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-782eeca1-aa24-49dd-ae46-c765555443e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] validate_networks() for [('60b2c529-82f9-47ea-9951-24ba7b38ebc9', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:33:14.453802 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a99780df-63e7-4d3d-95fb-90181a601e9d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "POST /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.019267 Oct 17 04:33:14.455084 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 140/276] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Oct 17 04:33:13 2022] POST /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617/os-volume_attachments => generated 194 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:33:14.461002 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-52ad20ef-faa7-441e-9e03-f2db6c0e5140 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:14.461977 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-52ad20ef-faa7-441e-9e03-f2db6c0e5140 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:14.469947 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52ad20ef-faa7-441e-9e03-f2db6c0e5140 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:14.470609 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52ad20ef-faa7-441e-9e03-f2db6c0e5140 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:14.471570 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52ad20ef-faa7-441e-9e03-f2db6c0e5140 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:14.472345 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52ad20ef-faa7-441e-9e03-f2db6c0e5140 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:14.472810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52ad20ef-faa7-441e-9e03-f2db6c0e5140 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:14.473334 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-52ad20ef-faa7-441e-9e03-f2db6c0e5140 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:14.749020 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-52ad20ef-faa7-441e-9e03-f2db6c0e5140 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:14.757005 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-52ad20ef-faa7-441e-9e03-f2db6c0e5140 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1564 microversion: 2.1 time: 0.300263 Oct 17 04:33:14.757748 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 141/277] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:14 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1564 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:14.763261 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a8b9dd5e-e008-4f43-80c8-75b1a2ddcc55 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:14.763943 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a8b9dd5e-e008-4f43-80c8-75b1a2ddcc55 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:14.769982 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8b9dd5e-e008-4f43-80c8-75b1a2ddcc55 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:14.770744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8b9dd5e-e008-4f43-80c8-75b1a2ddcc55 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:14.771421 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8b9dd5e-e008-4f43-80c8-75b1a2ddcc55 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:14.772351 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8b9dd5e-e008-4f43-80c8-75b1a2ddcc55 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:14.773033 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8b9dd5e-e008-4f43-80c8-75b1a2ddcc55 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:14.774973 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8b9dd5e-e008-4f43-80c8-75b1a2ddcc55 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:15.023714 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a8b9dd5e-e008-4f43-80c8-75b1a2ddcc55 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:15.031918 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:15.036978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a8b9dd5e-e008-4f43-80c8-75b1a2ddcc55 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:15.039370 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a8b9dd5e-e008-4f43-80c8-75b1a2ddcc55 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:15.040632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a8b9dd5e-e008-4f43-80c8-75b1a2ddcc55 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1722 microversion: 2.20 time: 0.281684 Oct 17 04:33:15.041781 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 142/278] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:14 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:15.046825 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4d891cda-974a-42fb-96a7-a7ae0223318d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:15.047311 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4d891cda-974a-42fb-96a7-a7ae0223318d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:15.054096 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d891cda-974a-42fb-96a7-a7ae0223318d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:15.055077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d891cda-974a-42fb-96a7-a7ae0223318d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:15.055704 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d891cda-974a-42fb-96a7-a7ae0223318d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:15.056975 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d891cda-974a-42fb-96a7-a7ae0223318d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:15.058164 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d891cda-974a-42fb-96a7-a7ae0223318d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:15.058820 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d891cda-974a-42fb-96a7-a7ae0223318d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:15.154345 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4d891cda-974a-42fb-96a7-a7ae0223318d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111361 Oct 17 04:33:15.154942 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 143/279] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Oct 17 04:33:15 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:33:15.173449 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-782eeca1-aa24-49dd-ae46-c765555443e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:33:15.173953 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-782eeca1-aa24-49dd-ae46-c765555443e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:33:15.174507 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-782eeca1-aa24-49dd-ae46-c765555443e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:33:15.175010 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-782eeca1-aa24-49dd-ae46-c765555443e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:33:15.175625 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-782eeca1-aa24-49dd-ae46-c765555443e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:33:15.182824 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=15 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:15.185887 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-782eeca1-aa24-49dd-ae46-c765555443e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:15.186848 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-782eeca1-aa24-49dd-ae46-c765555443e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:15.187352 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-782eeca1-aa24-49dd-ae46-c765555443e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:15.188522 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-782eeca1-aa24-49dd-ae46-c765555443e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:15.189303 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-782eeca1-aa24-49dd-ae46-c765555443e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:15.190043 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-782eeca1-aa24-49dd-ae46-c765555443e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:15.210293 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-782eeca1-aa24-49dd-ae46-c765555443e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Getting quotas for project e022e6125e85417881ce226db7a5c764. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:33:15.215258 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-782eeca1-aa24-49dd-ae46-c765555443e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Getting quotas for user 59aa96241a8e4d9db6d255c38f618ca1 and project e022e6125e85417881ce226db7a5c764. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:33:15.227037 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-782eeca1-aa24-49dd-ae46-c765555443e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:33:15.230092 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-782eeca1-aa24-49dd-ae46-c765555443e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf655d8c-fb2f-42ef-a7a7-0386f57b58cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:33:15.291471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ae22b35-5913-44f6-ab3e-880c08c6a92a tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:15.292442 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9ae22b35-5913-44f6-ab3e-880c08c6a92a tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] [instance: 39992be4-54ec-43d5-860c-c04e357acb5c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:15.301617 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ae22b35-5913-44f6-ab3e-880c08c6a92a tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:15.303248 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ae22b35-5913-44f6-ab3e-880c08c6a92a tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:15.304127 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ae22b35-5913-44f6-ab3e-880c08c6a92a tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:15.304703 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-782eeca1-aa24-49dd-ae46-c765555443e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.041684 Oct 17 04:33:15.305714 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 137/280] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:33:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 04:33:15.313107 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ae22b35-5913-44f6-ab3e-880c08c6a92a tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:15.313836 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ae22b35-5913-44f6-ab3e-880c08c6a92a tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:15.314534 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9ae22b35-5913-44f6-ab3e-880c08c6a92a tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:15.336539 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-9ae22b35-5913-44f6-ab3e-880c08c6a92a tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] HTTP exception thrown: Instance 39992be4-54ec-43d5-860c-c04e357acb5c could not be found. Oct 17 04:33:15.337211 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-30989d0b-3abc-408d-be2d-a97c07679d26 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:15.338031 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-30989d0b-3abc-408d-be2d-a97c07679d26 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ae22b35-5913-44f6-ab3e-880c08c6a92a tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Request method failure captured: Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c HTTP/1.1 Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNrRGhNUHFu1WiUJHujQZ8x4UrPgm2bhl2fzvW_iMyYITcUSu9DvVKH1m91jA_eIwushcZgt2qwjVuUUYqkiYCNhA3ry4CMqdhMxaXgyvUDk2ae2Njx8XjCEFCSDfcGCepUudAMJvu4G2HZuzR87GtMvU68fG1y9Gw5w_a9UNxmmY-c Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: 34d5aaa16da54ea19e9c982c50540377 Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-VolumesActionsTest-1182194090 Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:33:15.338926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:33:15.340195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/34d5aaa16da54ea19e9c982c50540377"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_34d5aaa16da54ea19e9c982c50540377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/34d5aaa16da54ea19e9c982c50540377"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/34d5aaa16da54ea19e9c982c50540377"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:33:15.340195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-VolumesActionsTest-1182194090 Oct 17 04:33:15.340195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: 34d5aaa16da54ea19e9c982c50540377 Oct 17 04:33:15.340195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-VolumesActionsTest-1182194090 Oct 17 04:33:15.340195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-VolumesActionsTest-1182194090-project Oct 17 04:33:15.340195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:33:15.340195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:33:15.340195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 3fb7bee3a97e4312ba30451b4a5f980d Oct 17 04:33:15.340195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-VolumesActionsTest-1182194090-project Oct 17 04:33:15.340195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:33:15.340195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance 39992be4-54ec-43d5-860c-c04e357acb5c could not be found. Oct 17 04:33:15.340195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': '39992be4-54ec-43d5-860c-c04e357acb5c'} Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39992be4-54ec-43d5-860c-c04e357acb5c could not be found. Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:33:15.340921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:33:15.342961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:33:15.342961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:33:15.342961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:33:15.342961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:33:15.342961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:33:15.342961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:33:15.342961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:33:15.342961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39992be4-54ec-43d5-860c-c04e357acb5c could not be found. Oct 17 04:33:15.342961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:33:15.342961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:33:15.342961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:33:15.342961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:33:15.342961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:33:15.342961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:33:15.342961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:33:15.342961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:33:15.342961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39992be4-54ec-43d5-860c-c04e357acb5c could not be found. Oct 17 04:33:15.342961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:33:15.345678 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9ae22b35-5913-44f6-ab3e-880c08c6a92a tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] Returning 404 to user: Instance 39992be4-54ec-43d5-860c-c04e357acb5c could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:33:15.346740 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9ae22b35-5913-44f6-ab3e-880c08c6a92a tempest-VolumesActionsTest-1182194090 tempest-VolumesActionsTest-1182194090-project] 10.222.0.40 "GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c" status: 404 len: 111 microversion: 2.1 time: 0.062857 Oct 17 04:33:15.357514 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 144/281] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:15 2022] GET /compute/v2.1/servers/39992be4-54ec-43d5-860c-c04e357acb5c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 04:33:15.442930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-30989d0b-3abc-408d-be2d-a97c07679d26 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:15.451380 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-30989d0b-3abc-408d-be2d-a97c07679d26 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1241 microversion: 2.1 time: 0.137233 Oct 17 04:33:15.452752 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 138/282] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:15 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1241 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:16.067683 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-57e5a508-89dd-48b3-b7bc-a71cacd1bdea tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:16.068297 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-57e5a508-89dd-48b3-b7bc-a71cacd1bdea tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:16.080881 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57e5a508-89dd-48b3-b7bc-a71cacd1bdea tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:16.085283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57e5a508-89dd-48b3-b7bc-a71cacd1bdea tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:16.085977 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57e5a508-89dd-48b3-b7bc-a71cacd1bdea tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:16.090619 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57e5a508-89dd-48b3-b7bc-a71cacd1bdea tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:16.091421 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57e5a508-89dd-48b3-b7bc-a71cacd1bdea tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:16.092014 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-57e5a508-89dd-48b3-b7bc-a71cacd1bdea tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:16.297097 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-57e5a508-89dd-48b3-b7bc-a71cacd1bdea tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:16.312352 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-57e5a508-89dd-48b3-b7bc-a71cacd1bdea tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:16.318824 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-57e5a508-89dd-48b3-b7bc-a71cacd1bdea tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:16.320662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-57e5a508-89dd-48b3-b7bc-a71cacd1bdea tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1722 microversion: 2.20 time: 0.257224 Oct 17 04:33:16.321510 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 145/283] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:16 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:16.481264 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d8686597-1a23-4704-aa87-16bcff43e33f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:16.481751 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d8686597-1a23-4704-aa87-16bcff43e33f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:16.502533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d8686597-1a23-4704-aa87-16bcff43e33f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:16.504773 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d8686597-1a23-4704-aa87-16bcff43e33f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:16.505266 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d8686597-1a23-4704-aa87-16bcff43e33f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:16.507062 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d8686597-1a23-4704-aa87-16bcff43e33f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:16.509605 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d8686597-1a23-4704-aa87-16bcff43e33f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:16.511699 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d8686597-1a23-4704-aa87-16bcff43e33f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:16.616378 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d8686597-1a23-4704-aa87-16bcff43e33f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:16.640242 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ee2824ed-f936-48ec-9866-59651c772090 req-a5841664-f122-4020-80fa-3f1c2c8fea9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5722cf2-3e88-4c8e-a533-e6a228c13a82", "tag": "d6e73103-0bcc-46c6-a3be-e7d793fb4195"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:16.662079 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d8686597-1a23-4704-aa87-16bcff43e33f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1293 microversion: 2.1 time: 0.187418 Oct 17 04:33:16.664875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 139/284] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:16 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1293 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:16.667868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ee2824ed-f936-48ec-9866-59651c772090 req-a5841664-f122-4020-80fa-3f1c2c8fea9b service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:16.668634 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ee2824ed-f936-48ec-9866-59651c772090 req-a5841664-f122-4020-80fa-3f1c2c8fea9b service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:16.669303 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ee2824ed-f936-48ec-9866-59651c772090 req-a5841664-f122-4020-80fa-3f1c2c8fea9b service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:16.683768 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ee2824ed-f936-48ec-9866-59651c772090 req-a5841664-f122-4020-80fa-3f1c2c8fea9b service nova] Creating event network-changed:d6e73103-0bcc-46c6-a3be-e7d793fb4195 for instance e5722cf2-3e88-4c8e-a533-e6a228c13a82 on hv-cinder-86155 Oct 17 04:33:16.688759 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ee2824ed-f936-48ec-9866-59651c772090 req-a5841664-f122-4020-80fa-3f1c2c8fea9b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054965 Oct 17 04:33:16.689667 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 146/285] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:33:17.349490 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b71d7ed3-80e1-4626-af06-339f2cc720c3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:17.350146 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b71d7ed3-80e1-4626-af06-339f2cc720c3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:17.357218 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b71d7ed3-80e1-4626-af06-339f2cc720c3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:17.357709 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b71d7ed3-80e1-4626-af06-339f2cc720c3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:17.358141 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b71d7ed3-80e1-4626-af06-339f2cc720c3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:17.358837 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b71d7ed3-80e1-4626-af06-339f2cc720c3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:17.359284 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b71d7ed3-80e1-4626-af06-339f2cc720c3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:17.359700 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b71d7ed3-80e1-4626-af06-339f2cc720c3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:17.496644 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-b71d7ed3-80e1-4626-af06-339f2cc720c3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:17.505328 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-b71d7ed3-80e1-4626-af06-339f2cc720c3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:17.506878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-b71d7ed3-80e1-4626-af06-339f2cc720c3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:17.508165 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b71d7ed3-80e1-4626-af06-339f2cc720c3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1722 microversion: 2.20 time: 0.162518 Oct 17 04:33:17.509045 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 140/286] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:17 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:33:17.689588 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3c931051-9efe-4f38-ba34-5785602de65e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:17.690946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3c931051-9efe-4f38-ba34-5785602de65e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:17.702815 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c931051-9efe-4f38-ba34-5785602de65e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:17.703475 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c931051-9efe-4f38-ba34-5785602de65e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:17.704091 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c931051-9efe-4f38-ba34-5785602de65e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:17.705371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c931051-9efe-4f38-ba34-5785602de65e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:17.706240 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c931051-9efe-4f38-ba34-5785602de65e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:17.707051 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c931051-9efe-4f38-ba34-5785602de65e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:17.782498 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-3c931051-9efe-4f38-ba34-5785602de65e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:17.795499 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3c931051-9efe-4f38-ba34-5785602de65e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1301 microversion: 2.1 time: 0.110656 Oct 17 04:33:17.797326 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 147/287] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:17 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1301 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:18.533821 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-98fb14d3-9180-4a60-807c-0cfa0093de53 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:18.534420 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-98fb14d3-9180-4a60-807c-0cfa0093de53 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:18.540259 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98fb14d3-9180-4a60-807c-0cfa0093de53 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:18.540735 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98fb14d3-9180-4a60-807c-0cfa0093de53 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:18.541245 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98fb14d3-9180-4a60-807c-0cfa0093de53 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:18.542433 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98fb14d3-9180-4a60-807c-0cfa0093de53 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:18.542883 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98fb14d3-9180-4a60-807c-0cfa0093de53 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:18.543309 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98fb14d3-9180-4a60-807c-0cfa0093de53 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:18.670565 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-98fb14d3-9180-4a60-807c-0cfa0093de53 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:18.678656 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-98fb14d3-9180-4a60-807c-0cfa0093de53 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:18.680126 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-98fb14d3-9180-4a60-807c-0cfa0093de53 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:18.681323 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-98fb14d3-9180-4a60-807c-0cfa0093de53 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1722 microversion: 2.20 time: 0.151382 Oct 17 04:33:18.681917 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 141/288] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:18 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:18.824309 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5f5d315b-a942-4d1e-b7a5-44e421a06e78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:18.824943 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5f5d315b-a942-4d1e-b7a5-44e421a06e78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:18.831556 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f5d315b-a942-4d1e-b7a5-44e421a06e78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:18.831879 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f5d315b-a942-4d1e-b7a5-44e421a06e78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:18.832310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f5d315b-a942-4d1e-b7a5-44e421a06e78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:18.832995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f5d315b-a942-4d1e-b7a5-44e421a06e78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:18.833464 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f5d315b-a942-4d1e-b7a5-44e421a06e78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:18.833880 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f5d315b-a942-4d1e-b7a5-44e421a06e78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:18.897211 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5f5d315b-a942-4d1e-b7a5-44e421a06e78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:18.904761 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5f5d315b-a942-4d1e-b7a5-44e421a06e78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1301 microversion: 2.1 time: 0.085076 Oct 17 04:33:18.905436 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 148/289] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:18 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1301 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:19.707157 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-34122b77-8315-44e6-8e63-19806da9548d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:19.707771 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-34122b77-8315-44e6-8e63-19806da9548d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:19.713785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34122b77-8315-44e6-8e63-19806da9548d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:19.714268 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34122b77-8315-44e6-8e63-19806da9548d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:19.714704 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34122b77-8315-44e6-8e63-19806da9548d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:19.715392 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34122b77-8315-44e6-8e63-19806da9548d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:19.715845 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34122b77-8315-44e6-8e63-19806da9548d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:19.716271 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-34122b77-8315-44e6-8e63-19806da9548d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:19.847246 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-34122b77-8315-44e6-8e63-19806da9548d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:19.855511 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-34122b77-8315-44e6-8e63-19806da9548d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:19.857003 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-34122b77-8315-44e6-8e63-19806da9548d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:19.858202 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-34122b77-8315-44e6-8e63-19806da9548d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1722 microversion: 2.20 time: 0.154966 Oct 17 04:33:19.858755 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 142/290] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:19 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:19.928847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6807ff23-ab73-44f2-b086-50ae6c8d1646 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:19.929499 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6807ff23-ab73-44f2-b086-50ae6c8d1646 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:19.936697 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6807ff23-ab73-44f2-b086-50ae6c8d1646 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:19.937291 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6807ff23-ab73-44f2-b086-50ae6c8d1646 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:19.937727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6807ff23-ab73-44f2-b086-50ae6c8d1646 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:19.938415 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6807ff23-ab73-44f2-b086-50ae6c8d1646 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:19.938889 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6807ff23-ab73-44f2-b086-50ae6c8d1646 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:19.939332 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6807ff23-ab73-44f2-b086-50ae6c8d1646 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:20.003586 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-6807ff23-ab73-44f2-b086-50ae6c8d1646 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:20.011910 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6807ff23-ab73-44f2-b086-50ae6c8d1646 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1301 microversion: 2.1 time: 0.086885 Oct 17 04:33:20.012571 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 149/291] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:19 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1301 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:20.883393 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-41985f05-1a1c-435d-9a57-a01be5c0466a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:20.884010 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-41985f05-1a1c-435d-9a57-a01be5c0466a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:20.890638 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41985f05-1a1c-435d-9a57-a01be5c0466a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:20.891114 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41985f05-1a1c-435d-9a57-a01be5c0466a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:20.891548 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41985f05-1a1c-435d-9a57-a01be5c0466a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:20.892232 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41985f05-1a1c-435d-9a57-a01be5c0466a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:20.892683 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41985f05-1a1c-435d-9a57-a01be5c0466a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:20.893127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41985f05-1a1c-435d-9a57-a01be5c0466a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:21.030908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-41985f05-1a1c-435d-9a57-a01be5c0466a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:21.034221 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-699809aa-8b66-4289-8b75-0cebb80e823b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:21.034911 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-699809aa-8b66-4289-8b75-0cebb80e823b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:21.041599 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-699809aa-8b66-4289-8b75-0cebb80e823b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:21.042594 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-699809aa-8b66-4289-8b75-0cebb80e823b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:21.043028 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-699809aa-8b66-4289-8b75-0cebb80e823b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:21.043726 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-699809aa-8b66-4289-8b75-0cebb80e823b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:21.044204 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-699809aa-8b66-4289-8b75-0cebb80e823b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:21.044628 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-699809aa-8b66-4289-8b75-0cebb80e823b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:21.045237 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-41985f05-1a1c-435d-9a57-a01be5c0466a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:21.046716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-41985f05-1a1c-435d-9a57-a01be5c0466a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:21.048099 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-41985f05-1a1c-435d-9a57-a01be5c0466a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1722 microversion: 2.20 time: 0.168671 Oct 17 04:33:21.049125 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 143/292] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:20 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:21.112404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-699809aa-8b66-4289-8b75-0cebb80e823b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:21.121459 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-699809aa-8b66-4289-8b75-0cebb80e823b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1299 microversion: 2.1 time: 0.091120 Oct 17 04:33:21.122040 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 150/293] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:21 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:33:22.077476 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-74c6578c-d371-4c66-a681-d89b2125b384 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:22.080289 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-74c6578c-d371-4c66-a681-d89b2125b384 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:22.098245 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74c6578c-d371-4c66-a681-d89b2125b384 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:22.100044 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74c6578c-d371-4c66-a681-d89b2125b384 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:22.104057 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74c6578c-d371-4c66-a681-d89b2125b384 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:22.105393 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74c6578c-d371-4c66-a681-d89b2125b384 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:22.106019 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74c6578c-d371-4c66-a681-d89b2125b384 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:22.106746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74c6578c-d371-4c66-a681-d89b2125b384 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:22.145635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b923b2de-a540-4831-a04a-1776125bef29 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:22.146242 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b923b2de-a540-4831-a04a-1776125bef29 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:22.161843 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b923b2de-a540-4831-a04a-1776125bef29 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:22.162338 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b923b2de-a540-4831-a04a-1776125bef29 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:22.165851 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b923b2de-a540-4831-a04a-1776125bef29 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:22.167185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b923b2de-a540-4831-a04a-1776125bef29 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:22.169374 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b923b2de-a540-4831-a04a-1776125bef29 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:22.169980 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b923b2de-a540-4831-a04a-1776125bef29 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:22.472560 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:22.705529 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b923b2de-a540-4831-a04a-1776125bef29 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:22.720442 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b923b2de-a540-4831-a04a-1776125bef29 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1367 microversion: 2.1 time: 0.578573 Oct 17 04:33:22.721011 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 151/294] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:22 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1367 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:22.745640 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2270ebec-da4d-481d-8e85-673be97c9b6a tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:22.753469 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2270ebec-da4d-481d-8e85-673be97c9b6a tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:22.753916 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2270ebec-da4d-481d-8e85-673be97c9b6a tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:22.754579 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-74c6578c-d371-4c66-a681-d89b2125b384 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:22.756663 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2270ebec-da4d-481d-8e85-673be97c9b6a tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:22.767144 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-74c6578c-d371-4c66-a681-d89b2125b384 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:22.769767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-74c6578c-d371-4c66-a681-d89b2125b384 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:22.771717 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-74c6578c-d371-4c66-a681-d89b2125b384 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1722 microversion: 2.20 time: 0.699860 Oct 17 04:33:22.773123 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 144/295] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:22 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1722 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:22.888151 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2270ebec-da4d-481d-8e85-673be97c9b6a tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Going to try to stop instance {{(pid=119127) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 04:33:22.956326 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2270ebec-da4d-481d-8e85-673be97c9b6a tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "POST /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617/action" status: 202 len: 0 microversion: 2.1 time: 0.233543 Oct 17 04:33:22.958169 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 152/296] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Oct 17 04:33:22 2022] POST /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:33:22.968386 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ff1f26bd-1eac-45f4-80e8-e66dd94dce60 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:22.970946 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ff1f26bd-1eac-45f4-80e8-e66dd94dce60 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:22.982841 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff1f26bd-1eac-45f4-80e8-e66dd94dce60 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:22.984315 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff1f26bd-1eac-45f4-80e8-e66dd94dce60 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:22.985126 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff1f26bd-1eac-45f4-80e8-e66dd94dce60 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:22.985712 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff1f26bd-1eac-45f4-80e8-e66dd94dce60 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:22.987218 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff1f26bd-1eac-45f4-80e8-e66dd94dce60 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:22.988178 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ff1f26bd-1eac-45f4-80e8-e66dd94dce60 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:23.159790 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-ff1f26bd-1eac-45f4-80e8-e66dd94dce60 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:23.173811 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ff1f26bd-1eac-45f4-80e8-e66dd94dce60 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1723 microversion: 2.1 time: 0.208173 Oct 17 04:33:23.175049 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 145/297] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:22 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:33:23.433719 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-737cfc2c-de28-45a9-8841-93694f741c9f req-bad1a972-2dfb-45b3-83bd-da111b623a4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77752d3b-6577-45d9-b7f4-1bca4ee444be", "tag": "68d2f18e-a6e0-4ab3-8073-de5deb76b4d2"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:23.458600 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-737cfc2c-de28-45a9-8841-93694f741c9f req-bad1a972-2dfb-45b3-83bd-da111b623a4b service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:23.459649 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-737cfc2c-de28-45a9-8841-93694f741c9f req-bad1a972-2dfb-45b3-83bd-da111b623a4b service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:23.460517 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-737cfc2c-de28-45a9-8841-93694f741c9f req-bad1a972-2dfb-45b3-83bd-da111b623a4b service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:23.479077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-737cfc2c-de28-45a9-8841-93694f741c9f req-bad1a972-2dfb-45b3-83bd-da111b623a4b service nova] Creating event network-changed:68d2f18e-a6e0-4ab3-8073-de5deb76b4d2 for instance 77752d3b-6577-45d9-b7f4-1bca4ee444be on hv-cinder-86155 Oct 17 04:33:23.487517 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-737cfc2c-de28-45a9-8841-93694f741c9f req-bad1a972-2dfb-45b3-83bd-da111b623a4b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067022 Oct 17 04:33:23.488599 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 153/298] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:33:23.752266 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f221a585-0681-4438-bbf0-73356e990ce7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:23.753339 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f221a585-0681-4438-bbf0-73356e990ce7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:23.767228 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f221a585-0681-4438-bbf0-73356e990ce7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:23.768429 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f221a585-0681-4438-bbf0-73356e990ce7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:23.769269 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f221a585-0681-4438-bbf0-73356e990ce7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:23.770133 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f221a585-0681-4438-bbf0-73356e990ce7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:23.772125 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f221a585-0681-4438-bbf0-73356e990ce7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:23.773584 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f221a585-0681-4438-bbf0-73356e990ce7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:23.803161 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6985cf92-2e84-4b61-abfa-efb9a22c2455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:23.803937 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6985cf92-2e84-4b61-abfa-efb9a22c2455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:23.819758 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6985cf92-2e84-4b61-abfa-efb9a22c2455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:23.821790 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6985cf92-2e84-4b61-abfa-efb9a22c2455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:23.825215 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6985cf92-2e84-4b61-abfa-efb9a22c2455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:23.826066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6985cf92-2e84-4b61-abfa-efb9a22c2455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:23.829950 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6985cf92-2e84-4b61-abfa-efb9a22c2455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:23.829950 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6985cf92-2e84-4b61-abfa-efb9a22c2455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:24.147130 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-6985cf92-2e84-4b61-abfa-efb9a22c2455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:24.167026 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-6985cf92-2e84-4b61-abfa-efb9a22c2455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:24.170467 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-6985cf92-2e84-4b61-abfa-efb9a22c2455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:24.178675 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6985cf92-2e84-4b61-abfa-efb9a22c2455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1743 microversion: 2.20 time: 0.380667 Oct 17 04:33:24.180132 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 154/299] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:23 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1743 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:33:24.188660 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f221a585-0681-4438-bbf0-73356e990ce7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:24.199235 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1d6f6992-2f2b-4dea-afe9-3c8db0c3be49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:24.200521 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1d6f6992-2f2b-4dea-afe9-3c8db0c3be49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:24.213839 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f221a585-0681-4438-bbf0-73356e990ce7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1367 microversion: 2.1 time: 0.465714 Oct 17 04:33:24.215843 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d6f6992-2f2b-4dea-afe9-3c8db0c3be49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:24.216677 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 146/300] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:23 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1367 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:24.217532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d6f6992-2f2b-4dea-afe9-3c8db0c3be49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:24.218423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d6f6992-2f2b-4dea-afe9-3c8db0c3be49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:24.219291 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d6f6992-2f2b-4dea-afe9-3c8db0c3be49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:24.220208 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d6f6992-2f2b-4dea-afe9-3c8db0c3be49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:24.221146 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1d6f6992-2f2b-4dea-afe9-3c8db0c3be49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:24.395722 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-1d6f6992-2f2b-4dea-afe9-3c8db0c3be49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:24.404771 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1d6f6992-2f2b-4dea-afe9-3c8db0c3be49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1723 microversion: 2.1 time: 0.210101 Oct 17 04:33:24.406050 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 155/301] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:24 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:25.211103 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3aceca7f-5fef-4103-a95a-774da25c23b0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:25.211684 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3aceca7f-5fef-4103-a95a-774da25c23b0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:25.214143 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:25.219565 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3aceca7f-5fef-4103-a95a-774da25c23b0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:25.220070 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3aceca7f-5fef-4103-a95a-774da25c23b0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:25.220507 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3aceca7f-5fef-4103-a95a-774da25c23b0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:25.221231 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3aceca7f-5fef-4103-a95a-774da25c23b0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:25.221684 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3aceca7f-5fef-4103-a95a-774da25c23b0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:25.222104 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3aceca7f-5fef-4103-a95a-774da25c23b0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:25.241785 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3741abfb-dbe2-4e93-95f7-21421abe9dff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:25.242519 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3741abfb-dbe2-4e93-95f7-21421abe9dff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:25.251876 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3741abfb-dbe2-4e93-95f7-21421abe9dff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:25.252401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3741abfb-dbe2-4e93-95f7-21421abe9dff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:25.252846 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3741abfb-dbe2-4e93-95f7-21421abe9dff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:25.253570 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3741abfb-dbe2-4e93-95f7-21421abe9dff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:25.254023 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3741abfb-dbe2-4e93-95f7-21421abe9dff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:25.254448 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3741abfb-dbe2-4e93-95f7-21421abe9dff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:25.428758 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3aceca7f-5fef-4103-a95a-774da25c23b0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:25.440603 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3aceca7f-5fef-4103-a95a-774da25c23b0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:25.442103 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3aceca7f-5fef-4103-a95a-774da25c23b0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:25.443300 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3aceca7f-5fef-4103-a95a-774da25c23b0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1743 microversion: 2.20 time: 0.236284 Oct 17 04:33:25.446030 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 147/302] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:25 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1743 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:25.447876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=7 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:25.465718 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-3741abfb-dbe2-4e93-95f7-21421abe9dff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:25.466255 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-644ae085-30e6-42e7-a3bd-f9e155770efa tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:25.467191 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-644ae085-30e6-42e7-a3bd-f9e155770efa tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:25.474908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-644ae085-30e6-42e7-a3bd-f9e155770efa tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:25.475638 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-644ae085-30e6-42e7-a3bd-f9e155770efa tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:25.476239 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-644ae085-30e6-42e7-a3bd-f9e155770efa tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:25.477277 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-644ae085-30e6-42e7-a3bd-f9e155770efa tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:25.477908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-644ae085-30e6-42e7-a3bd-f9e155770efa tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:25.479024 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-644ae085-30e6-42e7-a3bd-f9e155770efa tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:25.487140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3741abfb-dbe2-4e93-95f7-21421abe9dff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1367 microversion: 2.1 time: 0.249933 Oct 17 04:33:25.490997 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 156/303] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:25 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:25.538932 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-a69ef7d3-7d8f-4250-ba66-e106d11ada30 req-4cd71f19-cf7e-412b-bf72-3777c3de8630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee04d43c-6d11-4571-989e-90ee8175e03d", "name": "network-vif-plugged", "status": "completed", "tag": "f63f40c8-b445-4c27-a582-2ac29415fbeb"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:25.562193 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a69ef7d3-7d8f-4250-ba66-e106d11ada30 req-4cd71f19-cf7e-412b-bf72-3777c3de8630 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:25.563968 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a69ef7d3-7d8f-4250-ba66-e106d11ada30 req-4cd71f19-cf7e-412b-bf72-3777c3de8630 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:25.564954 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a69ef7d3-7d8f-4250-ba66-e106d11ada30 req-4cd71f19-cf7e-412b-bf72-3777c3de8630 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:25.585194 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-a69ef7d3-7d8f-4250-ba66-e106d11ada30 req-4cd71f19-cf7e-412b-bf72-3777c3de8630 service nova] Creating event network-vif-plugged:f63f40c8-b445-4c27-a582-2ac29415fbeb for instance ee04d43c-6d11-4571-989e-90ee8175e03d on hv-cinder-86155 Oct 17 04:33:25.591604 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-a69ef7d3-7d8f-4250-ba66-e106d11ada30 req-4cd71f19-cf7e-412b-bf72-3777c3de8630 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056732 Oct 17 04:33:25.592786 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 157/304] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:33:25.639806 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-644ae085-30e6-42e7-a3bd-f9e155770efa tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:25.649578 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-644ae085-30e6-42e7-a3bd-f9e155770efa tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1723 microversion: 2.1 time: 0.202156 Oct 17 04:33:25.651232 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 148/305] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:25 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:26.479386 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5a28155d-5604-4133-9150-47ba8a14f697 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:26.481919 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5a28155d-5604-4133-9150-47ba8a14f697 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:26.488261 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a28155d-5604-4133-9150-47ba8a14f697 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:26.488988 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a28155d-5604-4133-9150-47ba8a14f697 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:26.489669 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a28155d-5604-4133-9150-47ba8a14f697 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:26.490528 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a28155d-5604-4133-9150-47ba8a14f697 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:26.491164 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a28155d-5604-4133-9150-47ba8a14f697 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:26.491875 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a28155d-5604-4133-9150-47ba8a14f697 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:26.518187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a6fc0e18-b577-4455-be79-3b702e8be00c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:26.519812 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a6fc0e18-b577-4455-be79-3b702e8be00c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:26.527359 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6fc0e18-b577-4455-be79-3b702e8be00c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:26.528384 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6fc0e18-b577-4455-be79-3b702e8be00c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:26.529097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6fc0e18-b577-4455-be79-3b702e8be00c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:26.530263 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6fc0e18-b577-4455-be79-3b702e8be00c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:26.531183 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6fc0e18-b577-4455-be79-3b702e8be00c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:26.531833 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6fc0e18-b577-4455-be79-3b702e8be00c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:26.736495 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5a28155d-5604-4133-9150-47ba8a14f697 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:26.748368 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5a28155d-5604-4133-9150-47ba8a14f697 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:26.750454 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5a28155d-5604-4133-9150-47ba8a14f697 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:26.752421 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5a28155d-5604-4133-9150-47ba8a14f697 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1738 microversion: 2.20 time: 0.278442 Oct 17 04:33:26.770685 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 158/306] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:26 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1738 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:26.776360 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ffea1cfd-713e-4a8d-b535-716fbd491228 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:26.776873 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ffea1cfd-713e-4a8d-b535-716fbd491228 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:26.777730 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-a6fc0e18-b577-4455-be79-3b702e8be00c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:26.787069 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ffea1cfd-713e-4a8d-b535-716fbd491228 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:26.787839 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ffea1cfd-713e-4a8d-b535-716fbd491228 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:26.788452 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ffea1cfd-713e-4a8d-b535-716fbd491228 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:26.789359 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ffea1cfd-713e-4a8d-b535-716fbd491228 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:26.789973 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ffea1cfd-713e-4a8d-b535-716fbd491228 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:26.791085 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a6fc0e18-b577-4455-be79-3b702e8be00c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1367 microversion: 2.1 time: 0.275665 Oct 17 04:33:26.791471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ffea1cfd-713e-4a8d-b535-716fbd491228 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:26.807542 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 149/307] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:26 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:33:26.956169 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-ffea1cfd-713e-4a8d-b535-716fbd491228 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:26.964471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ffea1cfd-713e-4a8d-b535-716fbd491228 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1723 microversion: 2.1 time: 0.192593 Oct 17 04:33:26.965034 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 159/308] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:26 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:27.787191 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e1d55736-560b-4696-9a2d-36638b68ad85 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:27.787930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e1d55736-560b-4696-9a2d-36638b68ad85 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:27.794652 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1d55736-560b-4696-9a2d-36638b68ad85 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:27.795144 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1d55736-560b-4696-9a2d-36638b68ad85 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:27.795589 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1d55736-560b-4696-9a2d-36638b68ad85 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:27.796319 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1d55736-560b-4696-9a2d-36638b68ad85 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:27.796896 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1d55736-560b-4696-9a2d-36638b68ad85 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:27.797368 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1d55736-560b-4696-9a2d-36638b68ad85 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:27.819574 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5b666f0d-2049-43f2-b893-e9b1abf88965 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:27.820669 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5b666f0d-2049-43f2-b893-e9b1abf88965 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:27.828875 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b666f0d-2049-43f2-b893-e9b1abf88965 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:27.829399 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b666f0d-2049-43f2-b893-e9b1abf88965 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:27.829831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b666f0d-2049-43f2-b893-e9b1abf88965 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:27.830642 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b666f0d-2049-43f2-b893-e9b1abf88965 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:27.831193 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b666f0d-2049-43f2-b893-e9b1abf88965 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:27.831622 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5b666f0d-2049-43f2-b893-e9b1abf88965 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:28.005263 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e1d55736-560b-4696-9a2d-36638b68ad85 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:28.013710 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e1d55736-560b-4696-9a2d-36638b68ad85 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:28.015186 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e1d55736-560b-4696-9a2d-36638b68ad85 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:28.016394 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e1d55736-560b-4696-9a2d-36638b68ad85 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1738 microversion: 2.20 time: 0.233139 Oct 17 04:33:28.016966 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 150/309] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:27 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:28.017230 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5b666f0d-2049-43f2-b893-e9b1abf88965 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:28.022338 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9c749983-bd1f-4307-b6f4-103d772be8bb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:28.023186 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9c749983-bd1f-4307-b6f4-103d772be8bb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:28.025808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5b666f0d-2049-43f2-b893-e9b1abf88965 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1367 microversion: 2.1 time: 0.209670 Oct 17 04:33:28.033140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 160/310] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:27 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:33:28.033291 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c749983-bd1f-4307-b6f4-103d772be8bb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:28.033291 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c749983-bd1f-4307-b6f4-103d772be8bb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:28.033291 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c749983-bd1f-4307-b6f4-103d772be8bb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:28.033291 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c749983-bd1f-4307-b6f4-103d772be8bb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:28.033604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c749983-bd1f-4307-b6f4-103d772be8bb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:28.033604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c749983-bd1f-4307-b6f4-103d772be8bb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:28.158854 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-9c749983-bd1f-4307-b6f4-103d772be8bb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:28.167705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9c749983-bd1f-4307-b6f4-103d772be8bb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1723 microversion: 2.1 time: 0.149722 Oct 17 04:33:28.168266 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 151/311] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:28 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:29.050149 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ca9700ee-0df9-4205-b0b6-5a947bb7b22b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:29.051234 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ca9700ee-0df9-4205-b0b6-5a947bb7b22b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:29.052863 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-125d77ed-7f75-4a10-b882-96a3a4f70363 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:29.054850 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-125d77ed-7f75-4a10-b882-96a3a4f70363 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:29.058649 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca9700ee-0df9-4205-b0b6-5a947bb7b22b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:29.059142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca9700ee-0df9-4205-b0b6-5a947bb7b22b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:29.059565 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca9700ee-0df9-4205-b0b6-5a947bb7b22b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:29.060567 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca9700ee-0df9-4205-b0b6-5a947bb7b22b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:29.061201 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca9700ee-0df9-4205-b0b6-5a947bb7b22b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:29.062582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ca9700ee-0df9-4205-b0b6-5a947bb7b22b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:29.071549 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:29.074584 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-125d77ed-7f75-4a10-b882-96a3a4f70363 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:29.075667 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-125d77ed-7f75-4a10-b882-96a3a4f70363 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:29.076608 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-125d77ed-7f75-4a10-b882-96a3a4f70363 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:29.078379 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-125d77ed-7f75-4a10-b882-96a3a4f70363 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:29.079385 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-125d77ed-7f75-4a10-b882-96a3a4f70363 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:29.080287 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-125d77ed-7f75-4a10-b882-96a3a4f70363 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:29.125650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:29.542406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-ca9700ee-0df9-4205-b0b6-5a947bb7b22b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:29.550877 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ca9700ee-0df9-4205-b0b6-5a947bb7b22b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1367 microversion: 2.1 time: 0.504700 Oct 17 04:33:29.559825 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 152/312] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:29 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1367 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:29.563829 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-125d77ed-7f75-4a10-b882-96a3a4f70363 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:29.565034 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e18248b1-88d3-4bf8-8eb5-84b100163a62 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:29.569665 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e18248b1-88d3-4bf8-8eb5-84b100163a62 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:29.581000 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e18248b1-88d3-4bf8-8eb5-84b100163a62 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:29.585681 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e18248b1-88d3-4bf8-8eb5-84b100163a62 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:29.586364 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e18248b1-88d3-4bf8-8eb5-84b100163a62 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:29.587323 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e18248b1-88d3-4bf8-8eb5-84b100163a62 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:29.588570 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e18248b1-88d3-4bf8-8eb5-84b100163a62 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:29.588570 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e18248b1-88d3-4bf8-8eb5-84b100163a62 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:29.597389 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-125d77ed-7f75-4a10-b882-96a3a4f70363 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:29.601517 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-125d77ed-7f75-4a10-b882-96a3a4f70363 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:29.603146 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-125d77ed-7f75-4a10-b882-96a3a4f70363 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1738 microversion: 2.20 time: 0.562957 Oct 17 04:33:29.603841 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 161/313] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:29 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1738 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:29.879376 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e18248b1-88d3-4bf8-8eb5-84b100163a62 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:29.895694 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e18248b1-88d3-4bf8-8eb5-84b100163a62 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1723 microversion: 2.1 time: 0.334486 Oct 17 04:33:29.896926 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 153/314] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:29 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:30.585409 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e5c1640d-bcf2-42a5-9cc3-eeeedddabcb4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:30.586052 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e5c1640d-bcf2-42a5-9cc3-eeeedddabcb4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:30.606318 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5c1640d-bcf2-42a5-9cc3-eeeedddabcb4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:30.606828 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5c1640d-bcf2-42a5-9cc3-eeeedddabcb4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:30.607270 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5c1640d-bcf2-42a5-9cc3-eeeedddabcb4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:30.607993 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5c1640d-bcf2-42a5-9cc3-eeeedddabcb4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:30.608452 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5c1640d-bcf2-42a5-9cc3-eeeedddabcb4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:30.608885 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5c1640d-bcf2-42a5-9cc3-eeeedddabcb4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:30.633347 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5e3491e7-ffc7-4c4e-bb44-5e09194b6bf8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:30.635288 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5e3491e7-ffc7-4c4e-bb44-5e09194b6bf8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:30.645191 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e3491e7-ffc7-4c4e-bb44-5e09194b6bf8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:30.653474 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e3491e7-ffc7-4c4e-bb44-5e09194b6bf8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:30.657751 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e3491e7-ffc7-4c4e-bb44-5e09194b6bf8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:30.659210 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e3491e7-ffc7-4c4e-bb44-5e09194b6bf8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:30.661713 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e3491e7-ffc7-4c4e-bb44-5e09194b6bf8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:30.663165 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5e3491e7-ffc7-4c4e-bb44-5e09194b6bf8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:31.006550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-5e3491e7-ffc7-4c4e-bb44-5e09194b6bf8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:31.019596 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-5e3491e7-ffc7-4c4e-bb44-5e09194b6bf8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:31.021581 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-5e3491e7-ffc7-4c4e-bb44-5e09194b6bf8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:31.023091 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5e3491e7-ffc7-4c4e-bb44-5e09194b6bf8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1738 microversion: 2.20 time: 0.394795 Oct 17 04:33:31.039477 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 154/315] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:30 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1738 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:33:31.051821 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e5c1640d-bcf2-42a5-9cc3-eeeedddabcb4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:31.061445 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-260a7b91-2575-4ada-a564-4e7bd1955219 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:31.062344 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-260a7b91-2575-4ada-a564-4e7bd1955219 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:31.071151 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e5c1640d-bcf2-42a5-9cc3-eeeedddabcb4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1367 microversion: 2.1 time: 0.489692 Oct 17 04:33:31.075852 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 162/316] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:30 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1367 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:31.091748 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-260a7b91-2575-4ada-a564-4e7bd1955219 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:31.091748 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-260a7b91-2575-4ada-a564-4e7bd1955219 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:31.092174 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-260a7b91-2575-4ada-a564-4e7bd1955219 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:31.092901 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-260a7b91-2575-4ada-a564-4e7bd1955219 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:31.095840 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-260a7b91-2575-4ada-a564-4e7bd1955219 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:31.096401 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-260a7b91-2575-4ada-a564-4e7bd1955219 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:31.125309 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=100 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:31.290584 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-260a7b91-2575-4ada-a564-4e7bd1955219 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:31.301750 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-260a7b91-2575-4ada-a564-4e7bd1955219 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1723 microversion: 2.1 time: 0.261767 Oct 17 04:33:31.318616 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 155/317] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:31 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:32.060172 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c5d0d354-df5d-47e4-8b1d-5a0f51dee38c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:32.061513 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c5d0d354-df5d-47e4-8b1d-5a0f51dee38c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:32.090471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5d0d354-df5d-47e4-8b1d-5a0f51dee38c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:32.092223 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5d0d354-df5d-47e4-8b1d-5a0f51dee38c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:32.092987 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5d0d354-df5d-47e4-8b1d-5a0f51dee38c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:32.093941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5d0d354-df5d-47e4-8b1d-5a0f51dee38c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:32.094825 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5d0d354-df5d-47e4-8b1d-5a0f51dee38c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:32.095430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5d0d354-df5d-47e4-8b1d-5a0f51dee38c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:32.102162 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f0f66aa0-eb0c-45bb-9480-b82effc9edb8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:32.103991 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f0f66aa0-eb0c-45bb-9480-b82effc9edb8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:32.270758 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0f66aa0-eb0c-45bb-9480-b82effc9edb8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:32.276483 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0f66aa0-eb0c-45bb-9480-b82effc9edb8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:32.294560 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0f66aa0-eb0c-45bb-9480-b82effc9edb8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:32.306079 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0f66aa0-eb0c-45bb-9480-b82effc9edb8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:32.307142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0f66aa0-eb0c-45bb-9480-b82effc9edb8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:32.313765 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f0f66aa0-eb0c-45bb-9480-b82effc9edb8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:32.675272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c5d0d354-df5d-47e4-8b1d-5a0f51dee38c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:32.692629 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c5d0d354-df5d-47e4-8b1d-5a0f51dee38c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:32.695955 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c5d0d354-df5d-47e4-8b1d-5a0f51dee38c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:32.702593 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c5d0d354-df5d-47e4-8b1d-5a0f51dee38c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1738 microversion: 2.20 time: 0.646345 Oct 17 04:33:32.704602 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 163/318] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:32 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1738 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:32.715926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9bae4541-f53e-431b-8457-a592b59ae264 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:32.716814 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9bae4541-f53e-431b-8457-a592b59ae264 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:32.726818 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9bae4541-f53e-431b-8457-a592b59ae264 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:32.727866 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9bae4541-f53e-431b-8457-a592b59ae264 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:32.729319 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9bae4541-f53e-431b-8457-a592b59ae264 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:32.729804 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f0f66aa0-eb0c-45bb-9480-b82effc9edb8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:32.730558 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9bae4541-f53e-431b-8457-a592b59ae264 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:32.731122 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9bae4541-f53e-431b-8457-a592b59ae264 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:32.731831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9bae4541-f53e-431b-8457-a592b59ae264 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:32.744021 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f0f66aa0-eb0c-45bb-9480-b82effc9edb8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1367 microversion: 2.1 time: 0.645724 Oct 17 04:33:32.766744 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 156/319] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:32 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1367 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:32.777727 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-6542d36b-fb76-4624-a75a-54e9808caa9d req-48235a79-b175-424e-82ca-8934475d5548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77752d3b-6577-45d9-b7f4-1bca4ee444be", "name": "network-vif-plugged", "status": "completed", "tag": "68d2f18e-a6e0-4ab3-8073-de5deb76b4d2"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:32.793895 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:32.796533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6542d36b-fb76-4624-a75a-54e9808caa9d req-48235a79-b175-424e-82ca-8934475d5548 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:32.797588 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6542d36b-fb76-4624-a75a-54e9808caa9d req-48235a79-b175-424e-82ca-8934475d5548 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:32.798372 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-6542d36b-fb76-4624-a75a-54e9808caa9d req-48235a79-b175-424e-82ca-8934475d5548 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:32.817914 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-6542d36b-fb76-4624-a75a-54e9808caa9d req-48235a79-b175-424e-82ca-8934475d5548 service nova] Creating event network-vif-plugged:68d2f18e-a6e0-4ab3-8073-de5deb76b4d2 for instance 77752d3b-6577-45d9-b7f4-1bca4ee444be on hv-cinder-86155 Oct 17 04:33:32.837149 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-6542d36b-fb76-4624-a75a-54e9808caa9d req-48235a79-b175-424e-82ca-8934475d5548 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068095 Oct 17 04:33:32.839402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 157/320] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:33:33.100457 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-9bae4541-f53e-431b-8457-a592b59ae264 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:33.112899 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9bae4541-f53e-431b-8457-a592b59ae264 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1723 microversion: 2.1 time: 0.405453 Oct 17 04:33:33.114058 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 164/321] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:32 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1723 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:33.734892 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1e468195-00b5-4eb7-8f43-812e2840d8d1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:33.735584 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1e468195-00b5-4eb7-8f43-812e2840d8d1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:33.747310 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e468195-00b5-4eb7-8f43-812e2840d8d1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:33.747977 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e468195-00b5-4eb7-8f43-812e2840d8d1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:33.748620 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e468195-00b5-4eb7-8f43-812e2840d8d1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:33.750017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e468195-00b5-4eb7-8f43-812e2840d8d1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:33.750640 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e468195-00b5-4eb7-8f43-812e2840d8d1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:33.751531 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e468195-00b5-4eb7-8f43-812e2840d8d1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:33.776081 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fc5f0287-bb70-40b9-bf53-020085d2056b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:33.776432 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fc5f0287-bb70-40b9-bf53-020085d2056b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:33.782479 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc5f0287-bb70-40b9-bf53-020085d2056b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:33.782969 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc5f0287-bb70-40b9-bf53-020085d2056b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:33.783403 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc5f0287-bb70-40b9-bf53-020085d2056b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:33.784103 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc5f0287-bb70-40b9-bf53-020085d2056b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:33.784562 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc5f0287-bb70-40b9-bf53-020085d2056b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:33.784985 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fc5f0287-bb70-40b9-bf53-020085d2056b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:34.080630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-1e468195-00b5-4eb7-8f43-812e2840d8d1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:34.095408 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-1e468195-00b5-4eb7-8f43-812e2840d8d1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:34.100727 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-1e468195-00b5-4eb7-8f43-812e2840d8d1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:34.101460 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-fc5f0287-bb70-40b9-bf53-020085d2056b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:34.104059 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1e468195-00b5-4eb7-8f43-812e2840d8d1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1738 microversion: 2.20 time: 0.372073 Oct 17 04:33:34.121533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 158/322] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:33 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1738 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:34.136785 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fc5f0287-bb70-40b9-bf53-020085d2056b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1367 microversion: 2.1 time: 0.364756 Oct 17 04:33:34.141412 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4c01973d-2f6f-4280-ba7d-f9d23c93af98 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:34.142198 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4c01973d-2f6f-4280-ba7d-f9d23c93af98 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:34.157107 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 165/323] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:33 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:33:34.157414 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c01973d-2f6f-4280-ba7d-f9d23c93af98 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:34.157414 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c01973d-2f6f-4280-ba7d-f9d23c93af98 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:34.157982 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c01973d-2f6f-4280-ba7d-f9d23c93af98 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:34.158957 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c01973d-2f6f-4280-ba7d-f9d23c93af98 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:34.159645 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c01973d-2f6f-4280-ba7d-f9d23c93af98 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:34.160340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4c01973d-2f6f-4280-ba7d-f9d23c93af98 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:34.408516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-4c01973d-2f6f-4280-ba7d-f9d23c93af98 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:34.420277 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4c01973d-2f6f-4280-ba7d-f9d23c93af98 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1723 microversion: 2.1 time: 0.284199 Oct 17 04:33:34.421613 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 159/324] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:34 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:35.142975 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bfb9a077-58d0-4af2-ad7b-d66457e425c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:35.151224 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bfb9a077-58d0-4af2-ad7b-d66457e425c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:35.166599 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b9bf6d3b-3cd8-4c8c-ae08-b1e75a439dc1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:35.168105 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b9bf6d3b-3cd8-4c8c-ae08-b1e75a439dc1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:35.185139 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfb9a077-58d0-4af2-ad7b-d66457e425c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:35.186965 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfb9a077-58d0-4af2-ad7b-d66457e425c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:35.188003 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfb9a077-58d0-4af2-ad7b-d66457e425c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:35.189674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9bf6d3b-3cd8-4c8c-ae08-b1e75a439dc1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:35.190403 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfb9a077-58d0-4af2-ad7b-d66457e425c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:35.192321 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfb9a077-58d0-4af2-ad7b-d66457e425c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:35.193050 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9bf6d3b-3cd8-4c8c-ae08-b1e75a439dc1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:35.193757 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9bf6d3b-3cd8-4c8c-ae08-b1e75a439dc1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:35.193870 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bfb9a077-58d0-4af2-ad7b-d66457e425c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:35.194801 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9bf6d3b-3cd8-4c8c-ae08-b1e75a439dc1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:35.198843 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9bf6d3b-3cd8-4c8c-ae08-b1e75a439dc1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:35.199523 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9bf6d3b-3cd8-4c8c-ae08-b1e75a439dc1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:35.599386 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-bfb9a077-58d0-4af2-ad7b-d66457e425c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:35.609286 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-bfb9a077-58d0-4af2-ad7b-d66457e425c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:35.622806 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-bfb9a077-58d0-4af2-ad7b-d66457e425c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:35.641971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-b9bf6d3b-3cd8-4c8c-ae08-b1e75a439dc1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:35.652690 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b9bf6d3b-3cd8-4c8c-ae08-b1e75a439dc1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1367 microversion: 2.1 time: 0.490685 Oct 17 04:33:35.654589 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bfb9a077-58d0-4af2-ad7b-d66457e425c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1738 microversion: 2.20 time: 0.515618 Oct 17 04:33:35.656544 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 166/325] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:35 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1738 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:35.662237 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 160/326] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:35 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1367 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:35.663073 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-48f164ec-0a73-4d1f-99da-673708e767b1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:35.663861 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-48f164ec-0a73-4d1f-99da-673708e767b1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:35.670402 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48f164ec-0a73-4d1f-99da-673708e767b1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:35.671078 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48f164ec-0a73-4d1f-99da-673708e767b1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:35.671669 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48f164ec-0a73-4d1f-99da-673708e767b1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:35.672524 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48f164ec-0a73-4d1f-99da-673708e767b1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:35.673167 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48f164ec-0a73-4d1f-99da-673708e767b1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:35.673740 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48f164ec-0a73-4d1f-99da-673708e767b1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:35.864502 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-48f164ec-0a73-4d1f-99da-673708e767b1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:35.873736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-48f164ec-0a73-4d1f-99da-673708e767b1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1723 microversion: 2.1 time: 0.215952 Oct 17 04:33:35.874310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 167/327] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:35 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:36.687957 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-97e4f63c-2709-41f3-b7b8-6134f19dba20 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:36.689152 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-97e4f63c-2709-41f3-b7b8-6134f19dba20 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:36.692044 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-36f53976-8534-498d-9eb3-d44f527cbd45 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:36.692667 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-36f53976-8534-498d-9eb3-d44f527cbd45 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:36.704704 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36f53976-8534-498d-9eb3-d44f527cbd45 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:36.705451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36f53976-8534-498d-9eb3-d44f527cbd45 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:36.706024 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36f53976-8534-498d-9eb3-d44f527cbd45 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:36.706888 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36f53976-8534-498d-9eb3-d44f527cbd45 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:36.707473 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36f53976-8534-498d-9eb3-d44f527cbd45 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:36.708027 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-36f53976-8534-498d-9eb3-d44f527cbd45 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:36.708647 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97e4f63c-2709-41f3-b7b8-6134f19dba20 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:36.709172 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97e4f63c-2709-41f3-b7b8-6134f19dba20 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:36.709615 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97e4f63c-2709-41f3-b7b8-6134f19dba20 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:36.710317 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97e4f63c-2709-41f3-b7b8-6134f19dba20 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:36.710773 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97e4f63c-2709-41f3-b7b8-6134f19dba20 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:36.711201 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97e4f63c-2709-41f3-b7b8-6134f19dba20 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:37.031379 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-97e4f63c-2709-41f3-b7b8-6134f19dba20 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:37.055081 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-97e4f63c-2709-41f3-b7b8-6134f19dba20 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1557 microversion: 2.1 time: 0.374644 Oct 17 04:33:37.056657 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 161/328] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:36 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1557 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:37.062631 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-73bd1f0a-14b6-4a72-99f4-cdca78bc6fd2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:37.073984 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-73bd1f0a-14b6-4a72-99f4-cdca78bc6fd2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:37.081660 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73bd1f0a-14b6-4a72-99f4-cdca78bc6fd2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:37.082418 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73bd1f0a-14b6-4a72-99f4-cdca78bc6fd2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:37.085384 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73bd1f0a-14b6-4a72-99f4-cdca78bc6fd2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:37.086304 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73bd1f0a-14b6-4a72-99f4-cdca78bc6fd2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:37.086924 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73bd1f0a-14b6-4a72-99f4-cdca78bc6fd2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:37.091544 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-73bd1f0a-14b6-4a72-99f4-cdca78bc6fd2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:37.114355 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-36f53976-8534-498d-9eb3-d44f527cbd45 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:37.131699 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-36f53976-8534-498d-9eb3-d44f527cbd45 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:37.139633 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-36f53976-8534-498d-9eb3-d44f527cbd45 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:37.140880 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-36f53976-8534-498d-9eb3-d44f527cbd45 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1738 microversion: 2.20 time: 0.452747 Oct 17 04:33:37.149160 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 168/329] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:36 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1738 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:37.162907 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8ea2d63d-4c0c-42ec-8924-38b9a8028812 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:37.163305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8ea2d63d-4c0c-42ec-8924-38b9a8028812 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:37.170866 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ea2d63d-4c0c-42ec-8924-38b9a8028812 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:37.171354 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ea2d63d-4c0c-42ec-8924-38b9a8028812 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:37.173585 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ea2d63d-4c0c-42ec-8924-38b9a8028812 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:37.174464 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ea2d63d-4c0c-42ec-8924-38b9a8028812 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:37.179686 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ea2d63d-4c0c-42ec-8924-38b9a8028812 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:37.180305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ea2d63d-4c0c-42ec-8924-38b9a8028812 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:37.341717 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-73bd1f0a-14b6-4a72-99f4-cdca78bc6fd2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:37.360124 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-73bd1f0a-14b6-4a72-99f4-cdca78bc6fd2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1723 microversion: 2.1 time: 0.298424 Oct 17 04:33:37.362802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 162/330] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:37 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:37.389720 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8ea2d63d-4c0c-42ec-8924-38b9a8028812 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.239499 Oct 17 04:33:37.390580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 169/331] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Oct 17 04:33:37 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be/os-interface => generated 284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:33:38.172163 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e43d322e-c03f-4750-ac8c-4a27b72857eb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:38.176248 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e43d322e-c03f-4750-ac8c-4a27b72857eb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:38.209899 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e43d322e-c03f-4750-ac8c-4a27b72857eb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:38.210793 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e43d322e-c03f-4750-ac8c-4a27b72857eb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:38.211483 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e43d322e-c03f-4750-ac8c-4a27b72857eb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:38.212449 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e43d322e-c03f-4750-ac8c-4a27b72857eb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:38.216212 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e43d322e-c03f-4750-ac8c-4a27b72857eb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:38.218172 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e43d322e-c03f-4750-ac8c-4a27b72857eb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:38.391446 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-665187be-2201-4be1-920e-a9c1e3145cf7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:38.392824 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-665187be-2201-4be1-920e-a9c1e3145cf7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:38.410124 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-665187be-2201-4be1-920e-a9c1e3145cf7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:38.411283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-665187be-2201-4be1-920e-a9c1e3145cf7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:38.412170 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-665187be-2201-4be1-920e-a9c1e3145cf7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:38.413251 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-665187be-2201-4be1-920e-a9c1e3145cf7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:38.413937 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-665187be-2201-4be1-920e-a9c1e3145cf7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:38.414620 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-665187be-2201-4be1-920e-a9c1e3145cf7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:38.581116 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e43d322e-c03f-4750-ac8c-4a27b72857eb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:38.591625 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e43d322e-c03f-4750-ac8c-4a27b72857eb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:38.598540 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e43d322e-c03f-4750-ac8c-4a27b72857eb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:38.600775 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e43d322e-c03f-4750-ac8c-4a27b72857eb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1738 microversion: 2.20 time: 0.435527 Oct 17 04:33:38.606699 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 163/332] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:38 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1738 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:38.771766 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-665187be-2201-4be1-920e-a9c1e3145cf7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:38.785310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-665187be-2201-4be1-920e-a9c1e3145cf7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1723 microversion: 2.1 time: 0.399797 Oct 17 04:33:38.786712 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 170/333] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:38 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1723 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:33:39.183806 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-30740b07-fc8b-4baf-a925-06f84938b0fd req-b2c70e8d-e05c-4751-b4de-7bde67b89941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77752d3b-6577-45d9-b7f4-1bca4ee444be", "tag": "68d2f18e-a6e0-4ab3-8073-de5deb76b4d2"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:39.204870 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-30740b07-fc8b-4baf-a925-06f84938b0fd req-b2c70e8d-e05c-4751-b4de-7bde67b89941 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:39.211695 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-30740b07-fc8b-4baf-a925-06f84938b0fd req-b2c70e8d-e05c-4751-b4de-7bde67b89941 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:39.212460 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-30740b07-fc8b-4baf-a925-06f84938b0fd req-b2c70e8d-e05c-4751-b4de-7bde67b89941 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:39.248016 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-30740b07-fc8b-4baf-a925-06f84938b0fd req-b2c70e8d-e05c-4751-b4de-7bde67b89941 service nova] Creating event network-changed:68d2f18e-a6e0-4ab3-8073-de5deb76b4d2 for instance 77752d3b-6577-45d9-b7f4-1bca4ee444be on hv-cinder-86155 Oct 17 04:33:39.262729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-30740b07-fc8b-4baf-a925-06f84938b0fd req-b2c70e8d-e05c-4751-b4de-7bde67b89941 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083924 Oct 17 04:33:39.267812 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 164/334] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:33:39.660677 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a68262d4-8990-4d6e-a60f-aead97399326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:39.662031 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a68262d4-8990-4d6e-a60f-aead97399326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:39.672903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a68262d4-8990-4d6e-a60f-aead97399326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:39.673689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a68262d4-8990-4d6e-a60f-aead97399326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:39.674424 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a68262d4-8990-4d6e-a60f-aead97399326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:39.675402 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a68262d4-8990-4d6e-a60f-aead97399326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:39.676076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a68262d4-8990-4d6e-a60f-aead97399326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:39.677647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a68262d4-8990-4d6e-a60f-aead97399326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:39.816276 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-054bade1-d83b-43c4-81b0-3b080cc0fa38 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:39.817312 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-054bade1-d83b-43c4-81b0-3b080cc0fa38 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:39.844063 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-054bade1-d83b-43c4-81b0-3b080cc0fa38 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:39.844838 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-054bade1-d83b-43c4-81b0-3b080cc0fa38 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:39.845479 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-054bade1-d83b-43c4-81b0-3b080cc0fa38 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:39.846411 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-054bade1-d83b-43c4-81b0-3b080cc0fa38 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:39.847444 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-054bade1-d83b-43c4-81b0-3b080cc0fa38 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:39.848039 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-054bade1-d83b-43c4-81b0-3b080cc0fa38 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:40.241817 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a68262d4-8990-4d6e-a60f-aead97399326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:40.263745 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a68262d4-8990-4d6e-a60f-aead97399326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:40.265829 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a68262d4-8990-4d6e-a60f-aead97399326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:40.267276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a68262d4-8990-4d6e-a60f-aead97399326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1738 microversion: 2.20 time: 0.633798 Oct 17 04:33:40.268337 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 171/335] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:39 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1738 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:40.362375 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-054bade1-d83b-43c4-81b0-3b080cc0fa38 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:40.372575 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-054bade1-d83b-43c4-81b0-3b080cc0fa38 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1723 microversion: 2.1 time: 0.560450 Oct 17 04:33:40.396849 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 165/336] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:39 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1723 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:33:41.315460 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-acb97d6f-46b0-4731-b53c-e57e2cc2228c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:41.316085 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-acb97d6f-46b0-4731-b53c-e57e2cc2228c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:41.323245 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-acb97d6f-46b0-4731-b53c-e57e2cc2228c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:41.324028 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-acb97d6f-46b0-4731-b53c-e57e2cc2228c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:41.324631 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-acb97d6f-46b0-4731-b53c-e57e2cc2228c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:41.325563 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-acb97d6f-46b0-4731-b53c-e57e2cc2228c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:41.326186 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-acb97d6f-46b0-4731-b53c-e57e2cc2228c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:41.326796 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-acb97d6f-46b0-4731-b53c-e57e2cc2228c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:41.398020 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5a72057e-ff21-437a-a948-81def1c247e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:41.400782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5a72057e-ff21-437a-a948-81def1c247e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:41.413421 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a72057e-ff21-437a-a948-81def1c247e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:41.413915 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a72057e-ff21-437a-a948-81def1c247e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:41.414350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a72057e-ff21-437a-a948-81def1c247e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:41.415061 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a72057e-ff21-437a-a948-81def1c247e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:41.415513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a72057e-ff21-437a-a948-81def1c247e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:41.416540 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a72057e-ff21-437a-a948-81def1c247e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:41.590625 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-acb97d6f-46b0-4731-b53c-e57e2cc2228c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:41.604190 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-acb97d6f-46b0-4731-b53c-e57e2cc2228c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:41.606152 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-acb97d6f-46b0-4731-b53c-e57e2cc2228c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:41.607355 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-acb97d6f-46b0-4731-b53c-e57e2cc2228c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1738 microversion: 2.20 time: 0.310350 Oct 17 04:33:41.607922 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 172/337] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:41 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1738 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:41.639514 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-5a72057e-ff21-437a-a948-81def1c247e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:41.650012 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5a72057e-ff21-437a-a948-81def1c247e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1723 microversion: 2.1 time: 0.256057 Oct 17 04:33:41.662265 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 166/338] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:41 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:42.634767 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c6c1997b-d4ac-4fce-a1cc-fdb75e840326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:42.636093 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c6c1997b-d4ac-4fce-a1cc-fdb75e840326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:42.642570 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6c1997b-d4ac-4fce-a1cc-fdb75e840326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:42.643062 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6c1997b-d4ac-4fce-a1cc-fdb75e840326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:42.643477 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6c1997b-d4ac-4fce-a1cc-fdb75e840326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:42.644167 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6c1997b-d4ac-4fce-a1cc-fdb75e840326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:42.644613 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6c1997b-d4ac-4fce-a1cc-fdb75e840326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:42.645028 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6c1997b-d4ac-4fce-a1cc-fdb75e840326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:42.675039 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a6c2fb2d-68a6-4e77-b1d7-906c7c948c21 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:42.675705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a6c2fb2d-68a6-4e77-b1d7-906c7c948c21 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:42.682099 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6c2fb2d-68a6-4e77-b1d7-906c7c948c21 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:42.682781 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6c2fb2d-68a6-4e77-b1d7-906c7c948c21 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:42.684437 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6c2fb2d-68a6-4e77-b1d7-906c7c948c21 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:42.685323 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6c2fb2d-68a6-4e77-b1d7-906c7c948c21 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:42.685932 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6c2fb2d-68a6-4e77-b1d7-906c7c948c21 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:42.686522 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a6c2fb2d-68a6-4e77-b1d7-906c7c948c21 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:42.868925 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-a6c2fb2d-68a6-4e77-b1d7-906c7c948c21 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:42.877521 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a6c2fb2d-68a6-4e77-b1d7-906c7c948c21 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1723 microversion: 2.1 time: 0.206127 Oct 17 04:33:42.878331 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 167/339] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:42 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:33:42.900874 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c6c1997b-d4ac-4fce-a1cc-fdb75e840326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:42.910113 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c6c1997b-d4ac-4fce-a1cc-fdb75e840326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:42.914029 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c6c1997b-d4ac-4fce-a1cc-fdb75e840326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:42.915252 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c6c1997b-d4ac-4fce-a1cc-fdb75e840326 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1720 microversion: 2.20 time: 0.284492 Oct 17 04:33:42.915964 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 173/340] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:42 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1720 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:43.902675 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7961ccd1-d4ac-4901-8f00-662ffc2dde26 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:43.903253 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7961ccd1-d4ac-4901-8f00-662ffc2dde26 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:43.914902 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7961ccd1-d4ac-4901-8f00-662ffc2dde26 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:43.916366 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7961ccd1-d4ac-4901-8f00-662ffc2dde26 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:43.916828 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7961ccd1-d4ac-4901-8f00-662ffc2dde26 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:43.917754 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7961ccd1-d4ac-4901-8f00-662ffc2dde26 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:43.918205 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7961ccd1-d4ac-4901-8f00-662ffc2dde26 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:43.918823 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7961ccd1-d4ac-4901-8f00-662ffc2dde26 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:43.942130 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5a0891e6-5d66-4499-8df4-58212a7335b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:43.942744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5a0891e6-5d66-4499-8df4-58212a7335b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:43.960651 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a0891e6-5d66-4499-8df4-58212a7335b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:43.961636 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a0891e6-5d66-4499-8df4-58212a7335b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:43.962323 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a0891e6-5d66-4499-8df4-58212a7335b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:43.963818 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a0891e6-5d66-4499-8df4-58212a7335b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:43.965847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a0891e6-5d66-4499-8df4-58212a7335b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:43.976106 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a0891e6-5d66-4499-8df4-58212a7335b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:44.143333 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-7961ccd1-d4ac-4901-8f00-662ffc2dde26 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:44.152975 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7961ccd1-d4ac-4901-8f00-662ffc2dde26 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1723 microversion: 2.1 time: 0.254653 Oct 17 04:33:44.153593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 168/341] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:43 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:44.177992 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5a0891e6-5d66-4499-8df4-58212a7335b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:44.186676 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5a0891e6-5d66-4499-8df4-58212a7335b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:44.188369 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5a0891e6-5d66-4499-8df4-58212a7335b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:44.189787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5a0891e6-5d66-4499-8df4-58212a7335b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1720 microversion: 2.20 time: 0.251791 Oct 17 04:33:44.190359 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 174/342] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:43 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1720 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:33:45.177408 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-287db3cd-cf42-44de-93a7-f9f3fd2e9682 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:45.178937 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-287db3cd-cf42-44de-93a7-f9f3fd2e9682 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:45.185365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-287db3cd-cf42-44de-93a7-f9f3fd2e9682 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:45.186111 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-287db3cd-cf42-44de-93a7-f9f3fd2e9682 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:45.186546 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-287db3cd-cf42-44de-93a7-f9f3fd2e9682 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:45.187237 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-287db3cd-cf42-44de-93a7-f9f3fd2e9682 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:45.187693 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-287db3cd-cf42-44de-93a7-f9f3fd2e9682 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:45.188119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-287db3cd-cf42-44de-93a7-f9f3fd2e9682 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:45.219101 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a3429e6-faf5-4c12-887d-31f9e1487677 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:45.220308 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1a3429e6-faf5-4c12-887d-31f9e1487677 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:45.227272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3429e6-faf5-4c12-887d-31f9e1487677 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:45.229039 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3429e6-faf5-4c12-887d-31f9e1487677 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:45.229692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3429e6-faf5-4c12-887d-31f9e1487677 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:45.230612 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3429e6-faf5-4c12-887d-31f9e1487677 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:45.231254 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3429e6-faf5-4c12-887d-31f9e1487677 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:45.231868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3429e6-faf5-4c12-887d-31f9e1487677 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:45.389558 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-287db3cd-cf42-44de-93a7-f9f3fd2e9682 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:45.398076 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-287db3cd-cf42-44de-93a7-f9f3fd2e9682 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1723 microversion: 2.1 time: 0.224785 Oct 17 04:33:45.418080 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 169/343] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:45 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:45.512478 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a3429e6-faf5-4c12-887d-31f9e1487677 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:45.528166 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a3429e6-faf5-4c12-887d-31f9e1487677 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:45.529903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a3429e6-faf5-4c12-887d-31f9e1487677 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:45.531317 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1a3429e6-faf5-4c12-887d-31f9e1487677 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1720 microversion: 2.20 time: 0.318922 Oct 17 04:33:45.532061 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 175/344] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:45 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1720 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:33:45.940234 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e57c8b1f-dd7c-4937-b162-13a7adb11cfa req-b3baa804-8d45-4658-8444-1740bc4257a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee04d43c-6d11-4571-989e-90ee8175e03d", "name": "network-vif-unplugged", "status": "completed", "tag": "f63f40c8-b445-4c27-a582-2ac29415fbeb"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:45.956636 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e57c8b1f-dd7c-4937-b162-13a7adb11cfa req-b3baa804-8d45-4658-8444-1740bc4257a5 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:45.957176 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e57c8b1f-dd7c-4937-b162-13a7adb11cfa req-b3baa804-8d45-4658-8444-1740bc4257a5 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:45.957600 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e57c8b1f-dd7c-4937-b162-13a7adb11cfa req-b3baa804-8d45-4658-8444-1740bc4257a5 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:45.973415 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e57c8b1f-dd7c-4937-b162-13a7adb11cfa req-b3baa804-8d45-4658-8444-1740bc4257a5 service nova] Creating event network-vif-unplugged:f63f40c8-b445-4c27-a582-2ac29415fbeb for instance ee04d43c-6d11-4571-989e-90ee8175e03d on hv-cinder-86155 Oct 17 04:33:45.980739 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e57c8b1f-dd7c-4937-b162-13a7adb11cfa req-b3baa804-8d45-4658-8444-1740bc4257a5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047556 Oct 17 04:33:45.981854 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 170/345] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:33:46.429729 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2fba9fe5-f8cd-432b-bcc9-7e07b7788160 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:46.430334 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2fba9fe5-f8cd-432b-bcc9-7e07b7788160 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:46.437026 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2fba9fe5-f8cd-432b-bcc9-7e07b7788160 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:46.437540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2fba9fe5-f8cd-432b-bcc9-7e07b7788160 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:46.437975 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2fba9fe5-f8cd-432b-bcc9-7e07b7788160 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:46.438666 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2fba9fe5-f8cd-432b-bcc9-7e07b7788160 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:46.439124 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2fba9fe5-f8cd-432b-bcc9-7e07b7788160 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:46.439548 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2fba9fe5-f8cd-432b-bcc9-7e07b7788160 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:46.558082 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-23c5185f-fea8-492d-bc55-9bab83248657 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:46.558930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-23c5185f-fea8-492d-bc55-9bab83248657 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:46.565103 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23c5185f-fea8-492d-bc55-9bab83248657 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:46.565671 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23c5185f-fea8-492d-bc55-9bab83248657 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:46.566187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23c5185f-fea8-492d-bc55-9bab83248657 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:46.566953 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23c5185f-fea8-492d-bc55-9bab83248657 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:46.567481 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23c5185f-fea8-492d-bc55-9bab83248657 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:46.567976 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23c5185f-fea8-492d-bc55-9bab83248657 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:46.574785 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-2fba9fe5-f8cd-432b-bcc9-7e07b7788160 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:46.583158 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2fba9fe5-f8cd-432b-bcc9-7e07b7788160 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1700 microversion: 2.1 time: 0.157322 Oct 17 04:33:46.583727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 176/346] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:46 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1700 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:46.606150 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-99935fec-0003-4623-a784-201d4bd3768b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:46.612323 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99935fec-0003-4623-a784-201d4bd3768b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:46.612842 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99935fec-0003-4623-a784-201d4bd3768b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:46.613383 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99935fec-0003-4623-a784-201d4bd3768b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:46.637751 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-99935fec-0003-4623-a784-201d4bd3768b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Going to try to start instance {{(pid=119127) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 04:33:46.663467 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:46.683945 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-99935fec-0003-4623-a784-201d4bd3768b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "POST /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617/action" status: 202 len: 0 microversion: 2.1 time: 0.081447 Oct 17 04:33:46.684549 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 177/347] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Oct 17 04:33:46 2022] POST /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:33:46.693893 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1c25c3ea-e737-4262-8728-cacd3c0695ba tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:46.694583 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1c25c3ea-e737-4262-8728-cacd3c0695ba tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:46.700820 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c25c3ea-e737-4262-8728-cacd3c0695ba tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:46.701345 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c25c3ea-e737-4262-8728-cacd3c0695ba tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:46.701854 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c25c3ea-e737-4262-8728-cacd3c0695ba tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:46.702972 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c25c3ea-e737-4262-8728-cacd3c0695ba tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:46.703553 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c25c3ea-e737-4262-8728-cacd3c0695ba tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:46.704115 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1c25c3ea-e737-4262-8728-cacd3c0695ba tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:46.706085 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-23c5185f-fea8-492d-bc55-9bab83248657 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:46.715472 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-23c5185f-fea8-492d-bc55-9bab83248657 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:46.716939 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-23c5185f-fea8-492d-bc55-9bab83248657 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:46.718601 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-23c5185f-fea8-492d-bc55-9bab83248657 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1663 microversion: 2.20 time: 0.164959 Oct 17 04:33:46.719188 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 171/348] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:46 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:33:46.746750 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cd26761b-1415-4f4f-981c-55b050fac7ce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5388e111-d7cf-4888-8db4-35cd7c84625f"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:46.749179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cd26761b-1415-4f4f-981c-55b050fac7ce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:46.755353 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd26761b-1415-4f4f-981c-55b050fac7ce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:46.755843 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd26761b-1415-4f4f-981c-55b050fac7ce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:46.756476 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd26761b-1415-4f4f-981c-55b050fac7ce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:46.757382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd26761b-1415-4f4f-981c-55b050fac7ce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:46.758014 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd26761b-1415-4f4f-981c-55b050fac7ce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:46.758634 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cd26761b-1415-4f4f-981c-55b050fac7ce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:46.857617 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-1c25c3ea-e737-4262-8728-cacd3c0695ba tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:46.866038 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1c25c3ea-e737-4262-8728-cacd3c0695ba tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1709 microversion: 2.1 time: 0.177205 Oct 17 04:33:46.869122 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 178/349] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:46 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1709 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:33:47.024357 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:47.150782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cd26761b-1415-4f4f-981c-55b050fac7ce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "POST /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.409286 Oct 17 04:33:47.151858 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 172/350] 10.222.0.40 () {62 vars in 1364 bytes} [Mon Oct 17 04:33:46 2022] POST /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d/os-volume_attachments => generated 188 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 04:33:47.289654 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-368cfdea-59b9-4967-bd34-ae5a0d5ef8e7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:47.290251 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-368cfdea-59b9-4967-bd34-ae5a0d5ef8e7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:47.299583 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-368cfdea-59b9-4967-bd34-ae5a0d5ef8e7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:47.300072 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-368cfdea-59b9-4967-bd34-ae5a0d5ef8e7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:47.300696 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-368cfdea-59b9-4967-bd34-ae5a0d5ef8e7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:47.301422 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-368cfdea-59b9-4967-bd34-ae5a0d5ef8e7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:47.301881 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-368cfdea-59b9-4967-bd34-ae5a0d5ef8e7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:47.302302 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-368cfdea-59b9-4967-bd34-ae5a0d5ef8e7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:47.352518 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-368cfdea-59b9-4967-bd34-ae5a0d5ef8e7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119127) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 04:33:47.437763 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-368cfdea-59b9-4967-bd34-ae5a0d5ef8e7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "POST /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d/action" status: 202 len: 0 microversion: 2.20 time: 0.152339 Oct 17 04:33:47.438842 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 179/351] 10.222.0.40 () {62 vars in 1319 bytes} [Mon Oct 17 04:33:47 2022] POST /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:33:47.447853 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3be62520-377b-497d-9595-f89f69c43e9f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:47.448495 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3be62520-377b-497d-9595-f89f69c43e9f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:47.456509 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3be62520-377b-497d-9595-f89f69c43e9f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:47.457230 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3be62520-377b-497d-9595-f89f69c43e9f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:47.457742 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3be62520-377b-497d-9595-f89f69c43e9f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:47.461354 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3be62520-377b-497d-9595-f89f69c43e9f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:47.462065 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3be62520-377b-497d-9595-f89f69c43e9f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:47.463202 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3be62520-377b-497d-9595-f89f69c43e9f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:47.593195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bf1834dc-1862-4d73-8667-ed71963f46aa tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2114982238", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1420702188", "security_groups": [{"name": "tempest-secgroup-smoke-756745865"}], "networks": [{"uuid": "98905e91-d61c-460b-b7b3-b0bac875b67e"}], "block_device_mapping_v2": [{"uuid": "40498496-fd4b-41c2-bb18-b06dc4573173", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:47.616712 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3be62520-377b-497d-9595-f89f69c43e9f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:47.626487 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3be62520-377b-497d-9595-f89f69c43e9f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:47.628057 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3be62520-377b-497d-9595-f89f69c43e9f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:47.629416 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3be62520-377b-497d-9595-f89f69c43e9f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1749 microversion: 2.20 time: 0.186040 Oct 17 04:33:47.630330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 173/352] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:47 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1749 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:33:47.743216 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-bf1834dc-1862-4d73-8667-ed71963f46aa tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] validate_networks() for [('98905e91-d61c-460b-b7b3-b0bac875b67e', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:33:47.896563 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6b19ba54-a2e7-4d0e-abc9-a2b22c25b914 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:47.897581 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6b19ba54-a2e7-4d0e-abc9-a2b22c25b914 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:47.905169 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b19ba54-a2e7-4d0e-abc9-a2b22c25b914 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:47.905660 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b19ba54-a2e7-4d0e-abc9-a2b22c25b914 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:47.906159 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b19ba54-a2e7-4d0e-abc9-a2b22c25b914 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:47.907112 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b19ba54-a2e7-4d0e-abc9-a2b22c25b914 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:47.907810 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b19ba54-a2e7-4d0e-abc9-a2b22c25b914 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:47.908510 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b19ba54-a2e7-4d0e-abc9-a2b22c25b914 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:48.430240 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-6b19ba54-a2e7-4d0e-abc9-a2b22c25b914 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:48.439236 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6b19ba54-a2e7-4d0e-abc9-a2b22c25b914 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1709 microversion: 2.1 time: 0.551380 Oct 17 04:33:48.440383 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 174/353] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:47 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1709 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:48.472300 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-bf1834dc-1862-4d73-8667-ed71963f46aa tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:33:48.472859 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-bf1834dc-1862-4d73-8667-ed71963f46aa tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:33:48.473213 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-bf1834dc-1862-4d73-8667-ed71963f46aa tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:33:48.473623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-bf1834dc-1862-4d73-8667-ed71963f46aa tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:33:48.474034 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-bf1834dc-1862-4d73-8667-ed71963f46aa tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:33:48.483547 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf1834dc-1862-4d73-8667-ed71963f46aa tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:48.484027 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf1834dc-1862-4d73-8667-ed71963f46aa tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:48.484560 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf1834dc-1862-4d73-8667-ed71963f46aa tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:48.485362 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf1834dc-1862-4d73-8667-ed71963f46aa tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:48.485847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf1834dc-1862-4d73-8667-ed71963f46aa tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:48.486270 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bf1834dc-1862-4d73-8667-ed71963f46aa tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:48.506052 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-bf1834dc-1862-4d73-8667-ed71963f46aa tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Getting quotas for project 164c660f217f4b29b914caf14b773b61. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:33:48.510775 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-bf1834dc-1862-4d73-8667-ed71963f46aa tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Getting quotas for user f5d133f6649d4f8b9318b19d1d748f6f and project 164c660f217f4b29b914caf14b773b61. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:33:48.568844 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bf1834dc-1862-4d73-8667-ed71963f46aa tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:33:48.571502 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bf1834dc-1862-4d73-8667-ed71963f46aa tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40498496-fd4b-41c2-bb18-b06dc4573173',volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:33:48.657409 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6d6d3220-a9a6-4ee4-97ac-f207a5c79b77 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:48.658635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6d6d3220-a9a6-4ee4-97ac-f207a5c79b77 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:48.664936 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d6d3220-a9a6-4ee4-97ac-f207a5c79b77 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:48.666411 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d6d3220-a9a6-4ee4-97ac-f207a5c79b77 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:48.666851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d6d3220-a9a6-4ee4-97ac-f207a5c79b77 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:48.667726 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d6d3220-a9a6-4ee4-97ac-f207a5c79b77 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:48.668184 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d6d3220-a9a6-4ee4-97ac-f207a5c79b77 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:48.668610 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6d6d3220-a9a6-4ee4-97ac-f207a5c79b77 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:48.734227 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bf1834dc-1862-4d73-8667-ed71963f46aa tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.144791 Oct 17 04:33:48.735511 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 180/354] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:33:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 04:33:48.750383 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-538295f8-301d-4d25-a0da-938c2aa8b56d tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:48.751215 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-538295f8-301d-4d25-a0da-938c2aa8b56d tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:48.845843 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-538295f8-301d-4d25-a0da-938c2aa8b56d tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:48.858174 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-538295f8-301d-4d25-a0da-938c2aa8b56d tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1089 microversion: 2.1 time: 0.114340 Oct 17 04:33:48.858771 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 181/355] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:48 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1089 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:48.867045 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-6d6d3220-a9a6-4ee4-97ac-f207a5c79b77 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:48.877842 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-6d6d3220-a9a6-4ee4-97ac-f207a5c79b77 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:48.879355 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-6d6d3220-a9a6-4ee4-97ac-f207a5c79b77 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:48.880795 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6d6d3220-a9a6-4ee4-97ac-f207a5c79b77 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1749 microversion: 2.20 time: 0.228114 Oct 17 04:33:48.882015 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 175/356] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:48 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1749 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:33:49.469016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6abf897a-7147-47eb-9d5b-e7f96029ffb8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:49.471922 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6abf897a-7147-47eb-9d5b-e7f96029ffb8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:49.482098 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6abf897a-7147-47eb-9d5b-e7f96029ffb8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:49.482807 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6abf897a-7147-47eb-9d5b-e7f96029ffb8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:49.483062 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6abf897a-7147-47eb-9d5b-e7f96029ffb8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:49.483886 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6abf897a-7147-47eb-9d5b-e7f96029ffb8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:49.484339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6abf897a-7147-47eb-9d5b-e7f96029ffb8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:49.484776 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6abf897a-7147-47eb-9d5b-e7f96029ffb8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:49.649570 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-6abf897a-7147-47eb-9d5b-e7f96029ffb8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:49.669971 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6abf897a-7147-47eb-9d5b-e7f96029ffb8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1713 microversion: 2.1 time: 0.209953 Oct 17 04:33:49.672405 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 182/357] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:49 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1713 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:49.884699 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0eede3b1-e0ce-4db9-bbe2-a8c1ec3acf57 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:49.886388 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0eede3b1-e0ce-4db9-bbe2-a8c1ec3acf57 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:49.895327 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0eede3b1-e0ce-4db9-bbe2-a8c1ec3acf57 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:49.896093 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0eede3b1-e0ce-4db9-bbe2-a8c1ec3acf57 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:49.896728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0eede3b1-e0ce-4db9-bbe2-a8c1ec3acf57 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:49.897526 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0eede3b1-e0ce-4db9-bbe2-a8c1ec3acf57 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:49.898039 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0eede3b1-e0ce-4db9-bbe2-a8c1ec3acf57 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:49.898663 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0eede3b1-e0ce-4db9-bbe2-a8c1ec3acf57 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:49.913123 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c578e282-011d-401b-b672-f6ab82e0b6c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:49.914136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c578e282-011d-401b-b672-f6ab82e0b6c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:49.922651 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c578e282-011d-401b-b672-f6ab82e0b6c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:49.923349 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c578e282-011d-401b-b672-f6ab82e0b6c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:49.923974 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c578e282-011d-401b-b672-f6ab82e0b6c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:49.924889 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c578e282-011d-401b-b672-f6ab82e0b6c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:49.925837 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c578e282-011d-401b-b672-f6ab82e0b6c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:49.926552 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c578e282-011d-401b-b672-f6ab82e0b6c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:49.973640 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-0eede3b1-e0ce-4db9-bbe2-a8c1ec3acf57 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:49.984780 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0eede3b1-e0ce-4db9-bbe2-a8c1ec3acf57 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1187 microversion: 2.1 time: 0.105633 Oct 17 04:33:49.993122 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 176/358] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:49 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1187 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:50.074223 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c578e282-011d-401b-b672-f6ab82e0b6c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:50.083704 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c578e282-011d-401b-b672-f6ab82e0b6c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:50.085221 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c578e282-011d-401b-b672-f6ab82e0b6c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:50.086382 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c578e282-011d-401b-b672-f6ab82e0b6c8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1751 microversion: 2.20 time: 0.178320 Oct 17 04:33:50.086943 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 183/359] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:49 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:51.018037 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4885a1cf-2c69-4cae-8aa7-dff6380f245e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:51.018664 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4885a1cf-2c69-4cae-8aa7-dff6380f245e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:51.046700 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4885a1cf-2c69-4cae-8aa7-dff6380f245e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:51.047200 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4885a1cf-2c69-4cae-8aa7-dff6380f245e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:51.047641 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4885a1cf-2c69-4cae-8aa7-dff6380f245e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:51.048422 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4885a1cf-2c69-4cae-8aa7-dff6380f245e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:51.048879 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4885a1cf-2c69-4cae-8aa7-dff6380f245e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:51.049334 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4885a1cf-2c69-4cae-8aa7-dff6380f245e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:51.117651 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0a8fd84a-4625-43bb-9ed3-bfa021b73391 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:51.119734 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0a8fd84a-4625-43bb-9ed3-bfa021b73391 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:51.129871 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a8fd84a-4625-43bb-9ed3-bfa021b73391 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:51.130395 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a8fd84a-4625-43bb-9ed3-bfa021b73391 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:51.130834 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a8fd84a-4625-43bb-9ed3-bfa021b73391 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:51.131534 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a8fd84a-4625-43bb-9ed3-bfa021b73391 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:51.131979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a8fd84a-4625-43bb-9ed3-bfa021b73391 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:51.132592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a8fd84a-4625-43bb-9ed3-bfa021b73391 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:51.307579 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-4885a1cf-2c69-4cae-8aa7-dff6380f245e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:51.316220 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4885a1cf-2c69-4cae-8aa7-dff6380f245e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1272 microversion: 2.1 time: 0.311445 Oct 17 04:33:51.317227 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 177/360] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:51 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1272 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:51.340831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-0a8fd84a-4625-43bb-9ed3-bfa021b73391 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:51.359111 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-0a8fd84a-4625-43bb-9ed3-bfa021b73391 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:51.360576 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-0a8fd84a-4625-43bb-9ed3-bfa021b73391 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:51.361821 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0a8fd84a-4625-43bb-9ed3-bfa021b73391 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.250443 Oct 17 04:33:51.362383 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 184/361] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:51 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:52.340101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-45c9c857-8c3e-45be-a887-b5eae6820662 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:52.340722 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-45c9c857-8c3e-45be-a887-b5eae6820662 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:52.346682 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45c9c857-8c3e-45be-a887-b5eae6820662 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:52.347158 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45c9c857-8c3e-45be-a887-b5eae6820662 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:52.347586 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45c9c857-8c3e-45be-a887-b5eae6820662 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:52.348449 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45c9c857-8c3e-45be-a887-b5eae6820662 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:52.349060 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45c9c857-8c3e-45be-a887-b5eae6820662 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:52.349498 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-45c9c857-8c3e-45be-a887-b5eae6820662 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:52.388402 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d6fc3413-3fc4-4ed6-9190-652d3a7bffdd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:52.389002 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d6fc3413-3fc4-4ed6-9190-652d3a7bffdd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:52.401318 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6fc3413-3fc4-4ed6-9190-652d3a7bffdd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:52.401853 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6fc3413-3fc4-4ed6-9190-652d3a7bffdd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:52.402289 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6fc3413-3fc4-4ed6-9190-652d3a7bffdd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:52.403611 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6fc3413-3fc4-4ed6-9190-652d3a7bffdd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:52.404082 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6fc3413-3fc4-4ed6-9190-652d3a7bffdd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:52.404499 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d6fc3413-3fc4-4ed6-9190-652d3a7bffdd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:52.541707 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-45c9c857-8c3e-45be-a887-b5eae6820662 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:52.551373 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-45c9c857-8c3e-45be-a887-b5eae6820662 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.215406 Oct 17 04:33:52.552012 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 178/362] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:52 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:52.571994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-8fb9fff2-06a9-484c-81a8-a939c6bac31a req-d7c84141-13bf-48bf-8a7b-1a2f59f19043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c04fcc98-6f6b-4092-ba63-364498327bb6", "tag": "5018bca9-d0fd-4019-a69a-d25003f4d4da"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:33:52.584169 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8fb9fff2-06a9-484c-81a8-a939c6bac31a req-d7c84141-13bf-48bf-8a7b-1a2f59f19043 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:52.584649 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8fb9fff2-06a9-484c-81a8-a939c6bac31a req-d7c84141-13bf-48bf-8a7b-1a2f59f19043 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:52.585125 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8fb9fff2-06a9-484c-81a8-a939c6bac31a req-d7c84141-13bf-48bf-8a7b-1a2f59f19043 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:52.607922 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-8fb9fff2-06a9-484c-81a8-a939c6bac31a req-d7c84141-13bf-48bf-8a7b-1a2f59f19043 service nova] Creating event network-changed:5018bca9-d0fd-4019-a69a-d25003f4d4da for instance c04fcc98-6f6b-4092-ba63-364498327bb6 on hv-cinder-86155 Oct 17 04:33:52.613863 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-8fb9fff2-06a9-484c-81a8-a939c6bac31a req-d7c84141-13bf-48bf-8a7b-1a2f59f19043 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060634 Oct 17 04:33:52.614600 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 179/363] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:33:52.651633 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-d6fc3413-3fc4-4ed6-9190-652d3a7bffdd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:52.661487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-d6fc3413-3fc4-4ed6-9190-652d3a7bffdd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:52.662955 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-d6fc3413-3fc4-4ed6-9190-652d3a7bffdd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:52.664112 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d6fc3413-3fc4-4ed6-9190-652d3a7bffdd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.280415 Oct 17 04:33:52.664973 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 185/364] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:52 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:33:53.576757 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eaf96fc4-a779-4a7a-b042-e2b207506e22 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:53.579441 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-eaf96fc4-a779-4a7a-b042-e2b207506e22 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:53.586581 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eaf96fc4-a779-4a7a-b042-e2b207506e22 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:53.588736 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eaf96fc4-a779-4a7a-b042-e2b207506e22 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:53.589431 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eaf96fc4-a779-4a7a-b042-e2b207506e22 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:53.590427 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eaf96fc4-a779-4a7a-b042-e2b207506e22 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:53.591130 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eaf96fc4-a779-4a7a-b042-e2b207506e22 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:53.591647 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eaf96fc4-a779-4a7a-b042-e2b207506e22 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:53.690915 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3808c2b4-6452-4462-aa83-b39ca631a2ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:53.691672 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3808c2b4-6452-4462-aa83-b39ca631a2ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:53.700468 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3808c2b4-6452-4462-aa83-b39ca631a2ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:53.701331 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3808c2b4-6452-4462-aa83-b39ca631a2ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:53.701854 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3808c2b4-6452-4462-aa83-b39ca631a2ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:53.703093 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3808c2b4-6452-4462-aa83-b39ca631a2ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:53.703817 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3808c2b4-6452-4462-aa83-b39ca631a2ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:53.704535 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3808c2b4-6452-4462-aa83-b39ca631a2ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:53.754155 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-eaf96fc4-a779-4a7a-b042-e2b207506e22 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:53.764162 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-eaf96fc4-a779-4a7a-b042-e2b207506e22 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.192658 Oct 17 04:33:53.781420 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 180/365] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:53 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:53.886948 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-3808c2b4-6452-4462-aa83-b39ca631a2ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:53.898908 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-3808c2b4-6452-4462-aa83-b39ca631a2ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:53.901476 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-3808c2b4-6452-4462-aa83-b39ca631a2ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:53.902835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3808c2b4-6452-4462-aa83-b39ca631a2ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.216362 Oct 17 04:33:53.903518 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 186/366] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:53 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:54.787960 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9469923b-b03d-4278-b91e-4060f88aa09a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:54.789048 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9469923b-b03d-4278-b91e-4060f88aa09a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:54.796623 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9469923b-b03d-4278-b91e-4060f88aa09a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:54.797420 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9469923b-b03d-4278-b91e-4060f88aa09a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:54.798080 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9469923b-b03d-4278-b91e-4060f88aa09a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:54.799243 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9469923b-b03d-4278-b91e-4060f88aa09a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:54.799894 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9469923b-b03d-4278-b91e-4060f88aa09a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:54.800511 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9469923b-b03d-4278-b91e-4060f88aa09a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:54.932254 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fd6d0b00-5e32-462d-9b9c-f20631924505 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:54.933993 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fd6d0b00-5e32-462d-9b9c-f20631924505 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:54.942367 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd6d0b00-5e32-462d-9b9c-f20631924505 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:54.943155 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd6d0b00-5e32-462d-9b9c-f20631924505 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:54.943924 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd6d0b00-5e32-462d-9b9c-f20631924505 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:54.944855 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd6d0b00-5e32-462d-9b9c-f20631924505 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:54.945504 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd6d0b00-5e32-462d-9b9c-f20631924505 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:54.946192 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fd6d0b00-5e32-462d-9b9c-f20631924505 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:54.996891 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-9469923b-b03d-4278-b91e-4060f88aa09a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:55.007450 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9469923b-b03d-4278-b91e-4060f88aa09a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.223421 Oct 17 04:33:55.008877 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 181/367] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:54 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:33:55.147885 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-fd6d0b00-5e32-462d-9b9c-f20631924505 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:55.175904 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-fd6d0b00-5e32-462d-9b9c-f20631924505 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:55.178169 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-fd6d0b00-5e32-462d-9b9c-f20631924505 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:55.184127 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fd6d0b00-5e32-462d-9b9c-f20631924505 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.258067 Oct 17 04:33:55.185033 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 187/368] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:54 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:56.032100 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b475fd90-eb82-4a87-846a-8efb8bb550d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:56.032699 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b475fd90-eb82-4a87-846a-8efb8bb550d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:56.038842 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b475fd90-eb82-4a87-846a-8efb8bb550d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:56.039337 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b475fd90-eb82-4a87-846a-8efb8bb550d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:56.039778 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b475fd90-eb82-4a87-846a-8efb8bb550d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:56.040527 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b475fd90-eb82-4a87-846a-8efb8bb550d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:56.040981 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b475fd90-eb82-4a87-846a-8efb8bb550d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:56.041429 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b475fd90-eb82-4a87-846a-8efb8bb550d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:56.182768 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-b475fd90-eb82-4a87-846a-8efb8bb550d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:56.190984 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b475fd90-eb82-4a87-846a-8efb8bb550d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.162707 Oct 17 04:33:56.191672 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 182/369] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:56 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:56.211117 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-67941777-ddb3-45ad-9fee-9853eb9d0736 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:56.211702 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-67941777-ddb3-45ad-9fee-9853eb9d0736 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:56.219393 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67941777-ddb3-45ad-9fee-9853eb9d0736 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:56.219874 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67941777-ddb3-45ad-9fee-9853eb9d0736 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:56.220340 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67941777-ddb3-45ad-9fee-9853eb9d0736 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:56.221038 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67941777-ddb3-45ad-9fee-9853eb9d0736 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:56.221512 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67941777-ddb3-45ad-9fee-9853eb9d0736 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:56.221933 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-67941777-ddb3-45ad-9fee-9853eb9d0736 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:56.362751 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-67941777-ddb3-45ad-9fee-9853eb9d0736 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:56.372438 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-67941777-ddb3-45ad-9fee-9853eb9d0736 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:56.373935 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-67941777-ddb3-45ad-9fee-9853eb9d0736 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:56.375772 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-67941777-ddb3-45ad-9fee-9853eb9d0736 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.168590 Oct 17 04:33:56.376351 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 188/370] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:56 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:57.216185 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e7a56041-18ed-40a7-8df1-7f934be8d288 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:57.216936 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e7a56041-18ed-40a7-8df1-7f934be8d288 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:57.223160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e7a56041-18ed-40a7-8df1-7f934be8d288 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:57.223638 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e7a56041-18ed-40a7-8df1-7f934be8d288 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:57.224069 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e7a56041-18ed-40a7-8df1-7f934be8d288 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:57.224760 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e7a56041-18ed-40a7-8df1-7f934be8d288 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:57.225241 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e7a56041-18ed-40a7-8df1-7f934be8d288 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:57.225665 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e7a56041-18ed-40a7-8df1-7f934be8d288 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:57.370182 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e7a56041-18ed-40a7-8df1-7f934be8d288 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:57.378940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e7a56041-18ed-40a7-8df1-7f934be8d288 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.167675 Oct 17 04:33:57.379441 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 183/371] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:57 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:57.403094 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b8eedfab-1877-41dc-af11-c56241f3fa44 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:57.403711 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b8eedfab-1877-41dc-af11-c56241f3fa44 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:57.410565 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b8eedfab-1877-41dc-af11-c56241f3fa44 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:57.411057 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b8eedfab-1877-41dc-af11-c56241f3fa44 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:57.411493 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b8eedfab-1877-41dc-af11-c56241f3fa44 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:57.412197 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b8eedfab-1877-41dc-af11-c56241f3fa44 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:57.412650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b8eedfab-1877-41dc-af11-c56241f3fa44 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:57.413302 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b8eedfab-1877-41dc-af11-c56241f3fa44 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:57.552320 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b8eedfab-1877-41dc-af11-c56241f3fa44 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:57.562138 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b8eedfab-1877-41dc-af11-c56241f3fa44 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:57.563660 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b8eedfab-1877-41dc-af11-c56241f3fa44 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:57.564825 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b8eedfab-1877-41dc-af11-c56241f3fa44 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.166156 Oct 17 04:33:57.565407 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 189/372] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:57 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:33:58.403604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-43e047f9-aa00-43fa-b376-1873b8b2910c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:58.404171 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-43e047f9-aa00-43fa-b376-1873b8b2910c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:58.410681 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43e047f9-aa00-43fa-b376-1873b8b2910c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:58.411150 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43e047f9-aa00-43fa-b376-1873b8b2910c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:58.411862 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43e047f9-aa00-43fa-b376-1873b8b2910c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:58.412960 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43e047f9-aa00-43fa-b376-1873b8b2910c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:58.413425 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43e047f9-aa00-43fa-b376-1873b8b2910c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:58.413999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-43e047f9-aa00-43fa-b376-1873b8b2910c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:58.559714 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-43e047f9-aa00-43fa-b376-1873b8b2910c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:58.567461 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-43e047f9-aa00-43fa-b376-1873b8b2910c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.168387 Oct 17 04:33:58.568075 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 184/373] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:58 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:58.591655 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-15f35010-8342-4ebd-86c4-434231142849 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:58.592944 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-15f35010-8342-4ebd-86c4-434231142849 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:58.598504 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:58.600874 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15f35010-8342-4ebd-86c4-434231142849 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:58.601397 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15f35010-8342-4ebd-86c4-434231142849 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:58.601838 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15f35010-8342-4ebd-86c4-434231142849 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:58.602535 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15f35010-8342-4ebd-86c4-434231142849 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:58.603523 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15f35010-8342-4ebd-86c4-434231142849 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:58.603978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-15f35010-8342-4ebd-86c4-434231142849 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:58.736915 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-15f35010-8342-4ebd-86c4-434231142849 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:58.746636 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-15f35010-8342-4ebd-86c4-434231142849 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:58.748096 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-15f35010-8342-4ebd-86c4-434231142849 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:58.749525 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-15f35010-8342-4ebd-86c4-434231142849 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.161763 Oct 17 04:33:58.763875 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 190/374] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:58 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:33:59.590913 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6b3c4df6-25fa-4abe-a20c-7b5217ef539c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:59.591539 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6b3c4df6-25fa-4abe-a20c-7b5217ef539c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:59.597578 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b3c4df6-25fa-4abe-a20c-7b5217ef539c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:59.598068 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b3c4df6-25fa-4abe-a20c-7b5217ef539c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:59.598500 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b3c4df6-25fa-4abe-a20c-7b5217ef539c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:59.599199 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b3c4df6-25fa-4abe-a20c-7b5217ef539c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:59.599656 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b3c4df6-25fa-4abe-a20c-7b5217ef539c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:59.600082 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b3c4df6-25fa-4abe-a20c-7b5217ef539c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:59.742324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-6b3c4df6-25fa-4abe-a20c-7b5217ef539c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:59.750564 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6b3c4df6-25fa-4abe-a20c-7b5217ef539c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.163603 Oct 17 04:33:59.751135 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 185/375] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:33:59 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:33:59.775710 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9a843c5c-120b-4dba-801b-65b15962e17b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:33:59.776476 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9a843c5c-120b-4dba-801b-65b15962e17b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:33:59.778554 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=8 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:59.779736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:33:59.785415 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a843c5c-120b-4dba-801b-65b15962e17b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:59.785902 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a843c5c-120b-4dba-801b-65b15962e17b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:59.786340 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a843c5c-120b-4dba-801b-65b15962e17b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:59.787036 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a843c5c-120b-4dba-801b-65b15962e17b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:33:59.787490 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a843c5c-120b-4dba-801b-65b15962e17b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:33:59.787916 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9a843c5c-120b-4dba-801b-65b15962e17b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:33:59.932672 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-9a843c5c-120b-4dba-801b-65b15962e17b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:59.941495 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-9a843c5c-120b-4dba-801b-65b15962e17b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:59.942954 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-9a843c5c-120b-4dba-801b-65b15962e17b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:33:59.944250 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9a843c5c-120b-4dba-801b-65b15962e17b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.172488 Oct 17 04:33:59.944909 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 191/376] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:33:59 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:34:00.774484 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3800a36f-a212-455f-8749-ae8fa2c770af tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:00.775117 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3800a36f-a212-455f-8749-ae8fa2c770af tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:00.781560 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3800a36f-a212-455f-8749-ae8fa2c770af tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:00.782049 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3800a36f-a212-455f-8749-ae8fa2c770af tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:00.782488 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3800a36f-a212-455f-8749-ae8fa2c770af tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:00.783191 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3800a36f-a212-455f-8749-ae8fa2c770af tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:00.783647 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3800a36f-a212-455f-8749-ae8fa2c770af tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:00.784072 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3800a36f-a212-455f-8749-ae8fa2c770af tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:00.935884 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3800a36f-a212-455f-8749-ae8fa2c770af tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:00.944799 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3800a36f-a212-455f-8749-ae8fa2c770af tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.174296 Oct 17 04:34:00.946030 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 186/377] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:00 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:00.972136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d49956d5-9c72-41a7-b8ff-dd7b18eb767e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:00.973618 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d49956d5-9c72-41a7-b8ff-dd7b18eb767e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:00.981167 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d49956d5-9c72-41a7-b8ff-dd7b18eb767e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:00.982241 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d49956d5-9c72-41a7-b8ff-dd7b18eb767e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:00.983104 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d49956d5-9c72-41a7-b8ff-dd7b18eb767e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:00.984756 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d49956d5-9c72-41a7-b8ff-dd7b18eb767e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:00.985525 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d49956d5-9c72-41a7-b8ff-dd7b18eb767e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:00.986298 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d49956d5-9c72-41a7-b8ff-dd7b18eb767e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:01.165234 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-d49956d5-9c72-41a7-b8ff-dd7b18eb767e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:01.178522 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-d49956d5-9c72-41a7-b8ff-dd7b18eb767e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:01.180033 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-d49956d5-9c72-41a7-b8ff-dd7b18eb767e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:01.181317 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d49956d5-9c72-41a7-b8ff-dd7b18eb767e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.213253 Oct 17 04:34:01.181880 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 192/378] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:34:00 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:34:01.969870 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6a260213-53a1-4a93-ad75-eb14738da6ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:01.970511 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6a260213-53a1-4a93-ad75-eb14738da6ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:01.976691 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a260213-53a1-4a93-ad75-eb14738da6ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:01.977207 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a260213-53a1-4a93-ad75-eb14738da6ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:01.977691 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a260213-53a1-4a93-ad75-eb14738da6ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:01.978569 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a260213-53a1-4a93-ad75-eb14738da6ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:01.979032 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a260213-53a1-4a93-ad75-eb14738da6ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:01.979461 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a260213-53a1-4a93-ad75-eb14738da6ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:02.112605 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-6a260213-53a1-4a93-ad75-eb14738da6ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:02.121339 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6a260213-53a1-4a93-ad75-eb14738da6ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.155430 Oct 17 04:34:02.121840 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 187/379] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:01 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:02.207109 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3b6e6569-3842-403a-a897-01328c058549 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:02.207719 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3b6e6569-3842-403a-a897-01328c058549 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:02.215374 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b6e6569-3842-403a-a897-01328c058549 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:02.215863 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b6e6569-3842-403a-a897-01328c058549 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:02.216303 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b6e6569-3842-403a-a897-01328c058549 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:02.217006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b6e6569-3842-403a-a897-01328c058549 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:02.217492 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b6e6569-3842-403a-a897-01328c058549 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:02.217914 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3b6e6569-3842-403a-a897-01328c058549 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:02.347825 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-3b6e6569-3842-403a-a897-01328c058549 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:02.357881 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-3b6e6569-3842-403a-a897-01328c058549 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:02.359347 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-3b6e6569-3842-403a-a897-01328c058549 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:02.360514 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3b6e6569-3842-403a-a897-01328c058549 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.157321 Oct 17 04:34:02.361090 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 193/380] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:34:02 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:34:03.143856 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e288a0de-443c-421e-8808-a0678d3e75f7 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:03.144473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e288a0de-443c-421e-8808-a0678d3e75f7 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:03.146435 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=62 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:34:03.152118 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e288a0de-443c-421e-8808-a0678d3e75f7 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:03.152605 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e288a0de-443c-421e-8808-a0678d3e75f7 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:03.153035 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e288a0de-443c-421e-8808-a0678d3e75f7 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:03.153767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e288a0de-443c-421e-8808-a0678d3e75f7 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:03.154204 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e288a0de-443c-421e-8808-a0678d3e75f7 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:03.154622 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e288a0de-443c-421e-8808-a0678d3e75f7 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:03.172316 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=95,nova_cell1:UPDATE=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:34:03.288042 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e288a0de-443c-421e-8808-a0678d3e75f7 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:03.296135 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e288a0de-443c-421e-8808-a0678d3e75f7 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.156210 Oct 17 04:34:03.296692 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 188/381] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:03 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:03.387594 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8973369d-280f-42a3-9b76-10dd7ba4f416 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:03.388204 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8973369d-280f-42a3-9b76-10dd7ba4f416 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:03.394563 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8973369d-280f-42a3-9b76-10dd7ba4f416 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:03.395046 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8973369d-280f-42a3-9b76-10dd7ba4f416 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:03.395481 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8973369d-280f-42a3-9b76-10dd7ba4f416 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:03.396171 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8973369d-280f-42a3-9b76-10dd7ba4f416 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:03.396625 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8973369d-280f-42a3-9b76-10dd7ba4f416 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:03.397044 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8973369d-280f-42a3-9b76-10dd7ba4f416 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:03.528072 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-8973369d-280f-42a3-9b76-10dd7ba4f416 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:03.531416 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:34:03.537314 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-8973369d-280f-42a3-9b76-10dd7ba4f416 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:03.538764 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-8973369d-280f-42a3-9b76-10dd7ba4f416 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:03.539915 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8973369d-280f-42a3-9b76-10dd7ba4f416 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.156416 Oct 17 04:34:03.540466 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 194/382] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:34:03 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:34:04.318968 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2958007e-22c6-48dd-8ff5-5edba293db05 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:04.319608 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2958007e-22c6-48dd-8ff5-5edba293db05 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:04.325648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2958007e-22c6-48dd-8ff5-5edba293db05 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:04.326135 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2958007e-22c6-48dd-8ff5-5edba293db05 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:04.326594 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2958007e-22c6-48dd-8ff5-5edba293db05 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:04.327547 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2958007e-22c6-48dd-8ff5-5edba293db05 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:04.328003 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2958007e-22c6-48dd-8ff5-5edba293db05 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:04.328429 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2958007e-22c6-48dd-8ff5-5edba293db05 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:04.460735 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-2958007e-22c6-48dd-8ff5-5edba293db05 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:04.468540 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2958007e-22c6-48dd-8ff5-5edba293db05 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.153418 Oct 17 04:34:04.469128 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 189/383] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:04 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:04.566053 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-456af9da-83cd-41e0-bca6-81435cc69a6f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:04.566823 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-456af9da-83cd-41e0-bca6-81435cc69a6f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:04.574869 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-456af9da-83cd-41e0-bca6-81435cc69a6f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:04.575352 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-456af9da-83cd-41e0-bca6-81435cc69a6f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:04.575789 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-456af9da-83cd-41e0-bca6-81435cc69a6f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:04.576484 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-456af9da-83cd-41e0-bca6-81435cc69a6f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:04.576939 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-456af9da-83cd-41e0-bca6-81435cc69a6f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:04.577678 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-456af9da-83cd-41e0-bca6-81435cc69a6f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:04.710022 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-456af9da-83cd-41e0-bca6-81435cc69a6f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:04.718751 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-456af9da-83cd-41e0-bca6-81435cc69a6f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:04.720192 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-456af9da-83cd-41e0-bca6-81435cc69a6f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:04.721430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-456af9da-83cd-41e0-bca6-81435cc69a6f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.159220 Oct 17 04:34:04.721981 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 195/384] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:34:04 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:34:05.491837 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e1b1f066-b150-4a88-b693-b025be1dd192 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:05.492451 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e1b1f066-b150-4a88-b693-b025be1dd192 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:05.498678 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1b1f066-b150-4a88-b693-b025be1dd192 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:05.499155 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1b1f066-b150-4a88-b693-b025be1dd192 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:05.499591 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1b1f066-b150-4a88-b693-b025be1dd192 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:05.500272 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1b1f066-b150-4a88-b693-b025be1dd192 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:05.500723 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1b1f066-b150-4a88-b693-b025be1dd192 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:05.501170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e1b1f066-b150-4a88-b693-b025be1dd192 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:05.632260 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e1b1f066-b150-4a88-b693-b025be1dd192 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:05.640220 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e1b1f066-b150-4a88-b693-b025be1dd192 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.152327 Oct 17 04:34:05.640791 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 190/385] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:05 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:05.747244 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4a74638f-7203-4f80-864d-4b0589b51f62 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:05.747853 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4a74638f-7203-4f80-864d-4b0589b51f62 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:05.754645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a74638f-7203-4f80-864d-4b0589b51f62 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:05.755170 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a74638f-7203-4f80-864d-4b0589b51f62 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:05.755607 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a74638f-7203-4f80-864d-4b0589b51f62 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:05.756308 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a74638f-7203-4f80-864d-4b0589b51f62 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:05.756763 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a74638f-7203-4f80-864d-4b0589b51f62 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:05.757226 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a74638f-7203-4f80-864d-4b0589b51f62 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:05.883963 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-4a74638f-7203-4f80-864d-4b0589b51f62 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:05.895357 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-4a74638f-7203-4f80-864d-4b0589b51f62 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:05.896941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-4a74638f-7203-4f80-864d-4b0589b51f62 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:05.898195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4a74638f-7203-4f80-864d-4b0589b51f62 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.154986 Oct 17 04:34:05.898754 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 196/386] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:34:05 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:34:06.663341 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-824b9fe9-8c75-4826-8a1e-1ce4bdb899ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:06.663961 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-824b9fe9-8c75-4826-8a1e-1ce4bdb899ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:06.670551 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-824b9fe9-8c75-4826-8a1e-1ce4bdb899ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:06.671033 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-824b9fe9-8c75-4826-8a1e-1ce4bdb899ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:06.671474 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-824b9fe9-8c75-4826-8a1e-1ce4bdb899ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:06.672187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-824b9fe9-8c75-4826-8a1e-1ce4bdb899ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:06.672641 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-824b9fe9-8c75-4826-8a1e-1ce4bdb899ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:06.673067 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-824b9fe9-8c75-4826-8a1e-1ce4bdb899ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:06.799522 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-824b9fe9-8c75-4826-8a1e-1ce4bdb899ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:06.807819 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-824b9fe9-8c75-4826-8a1e-1ce4bdb899ee tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.147840 Oct 17 04:34:06.808383 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 191/387] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:06 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:06.923701 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8ee3f62c-7428-4fca-a4f6-eeba992835b5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:06.924333 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8ee3f62c-7428-4fca-a4f6-eeba992835b5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:06.930624 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ee3f62c-7428-4fca-a4f6-eeba992835b5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:06.931097 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ee3f62c-7428-4fca-a4f6-eeba992835b5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:06.931526 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ee3f62c-7428-4fca-a4f6-eeba992835b5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:06.932213 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ee3f62c-7428-4fca-a4f6-eeba992835b5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:06.932687 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ee3f62c-7428-4fca-a4f6-eeba992835b5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:06.933148 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8ee3f62c-7428-4fca-a4f6-eeba992835b5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:07.063908 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-8ee3f62c-7428-4fca-a4f6-eeba992835b5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:07.072590 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-8ee3f62c-7428-4fca-a4f6-eeba992835b5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:07.074074 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-8ee3f62c-7428-4fca-a4f6-eeba992835b5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:07.075248 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8ee3f62c-7428-4fca-a4f6-eeba992835b5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.155436 Oct 17 04:34:07.075806 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 197/388] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:34:06 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:34:07.830653 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-62be2b57-277e-48f1-90d2-80dd21c0d2e0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:07.831178 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-62be2b57-277e-48f1-90d2-80dd21c0d2e0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:07.837130 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62be2b57-277e-48f1-90d2-80dd21c0d2e0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:07.837614 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62be2b57-277e-48f1-90d2-80dd21c0d2e0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:07.838273 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62be2b57-277e-48f1-90d2-80dd21c0d2e0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:07.839232 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62be2b57-277e-48f1-90d2-80dd21c0d2e0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:07.839689 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62be2b57-277e-48f1-90d2-80dd21c0d2e0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:07.840117 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62be2b57-277e-48f1-90d2-80dd21c0d2e0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:07.968116 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-62be2b57-277e-48f1-90d2-80dd21c0d2e0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:07.975745 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-62be2b57-277e-48f1-90d2-80dd21c0d2e0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.149250 Oct 17 04:34:07.976304 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 192/389] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:07 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:08.101603 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-846f46b8-d2dd-4680-b4a0-0f609392f671 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:08.102208 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-846f46b8-d2dd-4680-b4a0-0f609392f671 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:08.109474 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-846f46b8-d2dd-4680-b4a0-0f609392f671 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:08.109948 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-846f46b8-d2dd-4680-b4a0-0f609392f671 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:08.110377 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-846f46b8-d2dd-4680-b4a0-0f609392f671 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:08.111057 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-846f46b8-d2dd-4680-b4a0-0f609392f671 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:08.111506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-846f46b8-d2dd-4680-b4a0-0f609392f671 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:08.111923 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-846f46b8-d2dd-4680-b4a0-0f609392f671 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:08.240821 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-846f46b8-d2dd-4680-b4a0-0f609392f671 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:08.250422 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-846f46b8-d2dd-4680-b4a0-0f609392f671 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:08.251867 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-846f46b8-d2dd-4680-b4a0-0f609392f671 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:08.253023 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-846f46b8-d2dd-4680-b4a0-0f609392f671 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.155402 Oct 17 04:34:08.253611 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 198/390] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:34:08 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:34:09.001104 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1082c55f-c5cb-43f0-9418-9edda4512d40 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:09.002299 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1082c55f-c5cb-43f0-9418-9edda4512d40 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:09.009777 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1082c55f-c5cb-43f0-9418-9edda4512d40 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:09.011507 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1082c55f-c5cb-43f0-9418-9edda4512d40 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:09.011953 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1082c55f-c5cb-43f0-9418-9edda4512d40 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:09.012657 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1082c55f-c5cb-43f0-9418-9edda4512d40 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:09.013129 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1082c55f-c5cb-43f0-9418-9edda4512d40 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:09.013550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1082c55f-c5cb-43f0-9418-9edda4512d40 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:09.153231 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-1082c55f-c5cb-43f0-9418-9edda4512d40 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:09.160924 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1082c55f-c5cb-43f0-9418-9edda4512d40 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.165039 Oct 17 04:34:09.161533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 193/391] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:08 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:09.278934 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d2c348d3-4387-49ec-bd98-bdf7584a816b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:09.279551 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d2c348d3-4387-49ec-bd98-bdf7584a816b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:09.286461 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d2c348d3-4387-49ec-bd98-bdf7584a816b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:09.286945 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d2c348d3-4387-49ec-bd98-bdf7584a816b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:09.287372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d2c348d3-4387-49ec-bd98-bdf7584a816b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:09.288058 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d2c348d3-4387-49ec-bd98-bdf7584a816b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:09.288511 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d2c348d3-4387-49ec-bd98-bdf7584a816b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:09.288928 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d2c348d3-4387-49ec-bd98-bdf7584a816b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:09.438523 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-d2c348d3-4387-49ec-bd98-bdf7584a816b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:09.449731 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-d2c348d3-4387-49ec-bd98-bdf7584a816b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:09.451274 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-d2c348d3-4387-49ec-bd98-bdf7584a816b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:09.453531 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d2c348d3-4387-49ec-bd98-bdf7584a816b tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.179306 Oct 17 04:34:09.454235 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 199/392] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:34:09 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:34:10.185556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-07595707-d663-4b26-8ee8-191a5437abc6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:10.186170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-07595707-d663-4b26-8ee8-191a5437abc6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:10.191928 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07595707-d663-4b26-8ee8-191a5437abc6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:10.192403 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07595707-d663-4b26-8ee8-191a5437abc6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:10.192832 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07595707-d663-4b26-8ee8-191a5437abc6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:10.193557 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07595707-d663-4b26-8ee8-191a5437abc6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:10.194090 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07595707-d663-4b26-8ee8-191a5437abc6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:10.194515 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-07595707-d663-4b26-8ee8-191a5437abc6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:10.337466 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-07595707-d663-4b26-8ee8-191a5437abc6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:10.345869 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-07595707-d663-4b26-8ee8-191a5437abc6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.164584 Oct 17 04:34:10.346439 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 194/393] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:10 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:10.481540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-64d1eac5-6968-45ce-b247-ec9f3d688ca0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:10.482070 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-64d1eac5-6968-45ce-b247-ec9f3d688ca0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:10.488351 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64d1eac5-6968-45ce-b247-ec9f3d688ca0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:10.488826 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64d1eac5-6968-45ce-b247-ec9f3d688ca0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:10.489289 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64d1eac5-6968-45ce-b247-ec9f3d688ca0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:10.489965 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64d1eac5-6968-45ce-b247-ec9f3d688ca0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:10.490414 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64d1eac5-6968-45ce-b247-ec9f3d688ca0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:10.490832 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64d1eac5-6968-45ce-b247-ec9f3d688ca0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:10.619263 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-64d1eac5-6968-45ce-b247-ec9f3d688ca0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:10.627916 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-64d1eac5-6968-45ce-b247-ec9f3d688ca0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:10.629380 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-64d1eac5-6968-45ce-b247-ec9f3d688ca0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:10.630535 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-64d1eac5-6968-45ce-b247-ec9f3d688ca0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.153534 Oct 17 04:34:10.631088 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 200/394] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:34:10 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:34:11.370375 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eec8d09d-b0a1-4b37-9257-04b6692b10ce tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:11.370965 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-eec8d09d-b0a1-4b37-9257-04b6692b10ce tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:11.376882 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eec8d09d-b0a1-4b37-9257-04b6692b10ce tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:11.377466 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eec8d09d-b0a1-4b37-9257-04b6692b10ce tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:11.377907 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eec8d09d-b0a1-4b37-9257-04b6692b10ce tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:11.378602 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eec8d09d-b0a1-4b37-9257-04b6692b10ce tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:11.379057 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eec8d09d-b0a1-4b37-9257-04b6692b10ce tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:11.380080 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eec8d09d-b0a1-4b37-9257-04b6692b10ce tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:11.518787 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-eec8d09d-b0a1-4b37-9257-04b6692b10ce tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:11.526948 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-eec8d09d-b0a1-4b37-9257-04b6692b10ce tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.160985 Oct 17 04:34:11.527517 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 195/395] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:11 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:11.656082 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8bf50288-7f2e-4660-9e8b-96834ebbd111 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:11.656693 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8bf50288-7f2e-4660-9e8b-96834ebbd111 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:11.663247 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bf50288-7f2e-4660-9e8b-96834ebbd111 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:11.663734 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bf50288-7f2e-4660-9e8b-96834ebbd111 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:11.664173 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bf50288-7f2e-4660-9e8b-96834ebbd111 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:11.664862 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bf50288-7f2e-4660-9e8b-96834ebbd111 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:11.665418 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bf50288-7f2e-4660-9e8b-96834ebbd111 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:11.665849 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bf50288-7f2e-4660-9e8b-96834ebbd111 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:11.759611 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-78ae946e-b42b-46b3-b6a5-81a91b91e5e2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a78de63d-2c53-4c69-b85c-68a82e156cb0"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:34:11.762586 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-78ae946e-b42b-46b3-b6a5-81a91b91e5e2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:11.768494 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78ae946e-b42b-46b3-b6a5-81a91b91e5e2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:11.768981 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78ae946e-b42b-46b3-b6a5-81a91b91e5e2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:11.769454 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78ae946e-b42b-46b3-b6a5-81a91b91e5e2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:11.770153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78ae946e-b42b-46b3-b6a5-81a91b91e5e2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:11.770605 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78ae946e-b42b-46b3-b6a5-81a91b91e5e2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:11.771029 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78ae946e-b42b-46b3-b6a5-81a91b91e5e2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:11.794736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-8bf50288-7f2e-4660-9e8b-96834ebbd111 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:11.803768 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-8bf50288-7f2e-4660-9e8b-96834ebbd111 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:11.805280 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-8bf50288-7f2e-4660-9e8b-96834ebbd111 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:11.806435 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8bf50288-7f2e-4660-9e8b-96834ebbd111 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.154266 Oct 17 04:34:11.807172 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 201/396] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:34:11 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:34:12.021777 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-78ae946e-b42b-46b3-b6a5-81a91b91e5e2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "POST /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265630 Oct 17 04:34:12.022415 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 196/397] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Oct 17 04:34:11 2022] POST /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:34:12.549858 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2620cdac-4627-4abb-befe-2de881282681 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:12.550533 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2620cdac-4627-4abb-befe-2de881282681 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:12.556307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2620cdac-4627-4abb-befe-2de881282681 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:12.557904 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2620cdac-4627-4abb-befe-2de881282681 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:12.558337 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2620cdac-4627-4abb-befe-2de881282681 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:12.559112 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2620cdac-4627-4abb-befe-2de881282681 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:12.559652 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2620cdac-4627-4abb-befe-2de881282681 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:12.560102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2620cdac-4627-4abb-befe-2de881282681 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:12.696784 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-2620cdac-4627-4abb-befe-2de881282681 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:12.705381 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2620cdac-4627-4abb-befe-2de881282681 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.159444 Oct 17 04:34:12.705963 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 202/398] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:12 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:12.832533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fdbae3d8-5454-4fb3-8a9b-9f0c36da724d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:12.833293 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fdbae3d8-5454-4fb3-8a9b-9f0c36da724d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:12.840427 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fdbae3d8-5454-4fb3-8a9b-9f0c36da724d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:12.840902 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fdbae3d8-5454-4fb3-8a9b-9f0c36da724d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:12.841353 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fdbae3d8-5454-4fb3-8a9b-9f0c36da724d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:12.842032 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fdbae3d8-5454-4fb3-8a9b-9f0c36da724d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:12.842479 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fdbae3d8-5454-4fb3-8a9b-9f0c36da724d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:12.842930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fdbae3d8-5454-4fb3-8a9b-9f0c36da724d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:12.971165 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-fdbae3d8-5454-4fb3-8a9b-9f0c36da724d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:12.980261 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-fdbae3d8-5454-4fb3-8a9b-9f0c36da724d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:12.981741 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-fdbae3d8-5454-4fb3-8a9b-9f0c36da724d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:12.982882 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fdbae3d8-5454-4fb3-8a9b-9f0c36da724d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.154668 Oct 17 04:34:12.983432 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 197/399] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:34:12 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:34:13.727794 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7096fa24-b981-4911-9b9b-7905ff5aeeb4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:13.728311 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7096fa24-b981-4911-9b9b-7905ff5aeeb4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:13.735373 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7096fa24-b981-4911-9b9b-7905ff5aeeb4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:13.735847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7096fa24-b981-4911-9b9b-7905ff5aeeb4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:13.736276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7096fa24-b981-4911-9b9b-7905ff5aeeb4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:13.736953 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7096fa24-b981-4911-9b9b-7905ff5aeeb4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:13.737427 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7096fa24-b981-4911-9b9b-7905ff5aeeb4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:13.737843 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7096fa24-b981-4911-9b9b-7905ff5aeeb4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:13.874477 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-7096fa24-b981-4911-9b9b-7905ff5aeeb4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:13.882209 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7096fa24-b981-4911-9b9b-7905ff5aeeb4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.158377 Oct 17 04:34:13.882774 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 203/400] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:13 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:14.007974 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fbbd2ec0-9c78-4a92-909d-fa2ef144570e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:14.008488 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fbbd2ec0-9c78-4a92-909d-fa2ef144570e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:14.015716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbbd2ec0-9c78-4a92-909d-fa2ef144570e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:14.016197 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbbd2ec0-9c78-4a92-909d-fa2ef144570e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:14.016649 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbbd2ec0-9c78-4a92-909d-fa2ef144570e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:14.017360 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbbd2ec0-9c78-4a92-909d-fa2ef144570e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:14.017811 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbbd2ec0-9c78-4a92-909d-fa2ef144570e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:14.018233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fbbd2ec0-9c78-4a92-909d-fa2ef144570e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:14.149279 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-fbbd2ec0-9c78-4a92-909d-fa2ef144570e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:14.159266 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-fbbd2ec0-9c78-4a92-909d-fa2ef144570e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:14.160698 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-fbbd2ec0-9c78-4a92-909d-fa2ef144570e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:14.161872 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fbbd2ec0-9c78-4a92-909d-fa2ef144570e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.157839 Oct 17 04:34:14.162421 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 198/401] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:34:14 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:34:14.904936 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-061212ed-d6ac-45b8-86a5-d2aebdc396f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:14.905588 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-061212ed-d6ac-45b8-86a5-d2aebdc396f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:14.912094 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-061212ed-d6ac-45b8-86a5-d2aebdc396f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:14.912574 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-061212ed-d6ac-45b8-86a5-d2aebdc396f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:14.913007 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-061212ed-d6ac-45b8-86a5-d2aebdc396f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:14.913720 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-061212ed-d6ac-45b8-86a5-d2aebdc396f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:14.914173 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-061212ed-d6ac-45b8-86a5-d2aebdc396f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:14.914595 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-061212ed-d6ac-45b8-86a5-d2aebdc396f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:15.091317 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-061212ed-d6ac-45b8-86a5-d2aebdc396f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:15.099041 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-061212ed-d6ac-45b8-86a5-d2aebdc396f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.197933 Oct 17 04:34:15.099805 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 204/402] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:14 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:15.187816 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0dd50636-354c-495f-b56b-131915eb63fa tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:15.188546 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0dd50636-354c-495f-b56b-131915eb63fa tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:15.194930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dd50636-354c-495f-b56b-131915eb63fa tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:15.195485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dd50636-354c-495f-b56b-131915eb63fa tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:15.195988 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dd50636-354c-495f-b56b-131915eb63fa tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:15.196749 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dd50636-354c-495f-b56b-131915eb63fa tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:15.197360 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dd50636-354c-495f-b56b-131915eb63fa tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:15.197853 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dd50636-354c-495f-b56b-131915eb63fa tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:15.346294 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-0dd50636-354c-495f-b56b-131915eb63fa tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:15.355563 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-0dd50636-354c-495f-b56b-131915eb63fa tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:15.357288 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-0dd50636-354c-495f-b56b-131915eb63fa tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:15.358685 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0dd50636-354c-495f-b56b-131915eb63fa tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.174862 Oct 17 04:34:15.359826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 199/403] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:34:15 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:34:16.123324 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-413d89e5-1790-420c-9a5a-5172855ee143 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:16.124501 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-413d89e5-1790-420c-9a5a-5172855ee143 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:16.131483 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-413d89e5-1790-420c-9a5a-5172855ee143 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:16.131970 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-413d89e5-1790-420c-9a5a-5172855ee143 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:16.132405 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-413d89e5-1790-420c-9a5a-5172855ee143 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:16.133124 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-413d89e5-1790-420c-9a5a-5172855ee143 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:16.133579 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-413d89e5-1790-420c-9a5a-5172855ee143 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:16.134005 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-413d89e5-1790-420c-9a5a-5172855ee143 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:16.267368 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-413d89e5-1790-420c-9a5a-5172855ee143 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:16.275097 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-413d89e5-1790-420c-9a5a-5172855ee143 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.156358 Oct 17 04:34:16.275857 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 205/404] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:16 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:16.385542 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dee421ee-d533-425f-933f-56be79f418f0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:16.386104 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dee421ee-d533-425f-933f-56be79f418f0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:16.392461 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dee421ee-d533-425f-933f-56be79f418f0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:16.392941 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dee421ee-d533-425f-933f-56be79f418f0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:16.393408 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dee421ee-d533-425f-933f-56be79f418f0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:16.394091 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dee421ee-d533-425f-933f-56be79f418f0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:16.394532 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dee421ee-d533-425f-933f-56be79f418f0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:16.394950 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dee421ee-d533-425f-933f-56be79f418f0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:16.521310 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-dee421ee-d533-425f-933f-56be79f418f0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:16.530026 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-dee421ee-d533-425f-933f-56be79f418f0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:16.531486 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-dee421ee-d533-425f-933f-56be79f418f0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:16.532654 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dee421ee-d533-425f-933f-56be79f418f0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.151416 Oct 17 04:34:16.533237 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 200/405] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:34:16 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:34:17.297735 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e479d97a-1979-4de4-9a8b-8507f845564e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:17.298347 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e479d97a-1979-4de4-9a8b-8507f845564e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:17.304661 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e479d97a-1979-4de4-9a8b-8507f845564e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:17.305177 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e479d97a-1979-4de4-9a8b-8507f845564e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:17.305618 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e479d97a-1979-4de4-9a8b-8507f845564e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:17.306302 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e479d97a-1979-4de4-9a8b-8507f845564e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:17.307419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e479d97a-1979-4de4-9a8b-8507f845564e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:17.307930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e479d97a-1979-4de4-9a8b-8507f845564e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:17.440618 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e479d97a-1979-4de4-9a8b-8507f845564e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:17.448888 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e479d97a-1979-4de4-9a8b-8507f845564e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.155020 Oct 17 04:34:17.449485 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 206/406] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:17 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:17.558897 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7d75f000-0ca0-455f-92f6-5f16ab571980 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:17.559504 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7d75f000-0ca0-455f-92f6-5f16ab571980 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:17.566061 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d75f000-0ca0-455f-92f6-5f16ab571980 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:17.566542 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d75f000-0ca0-455f-92f6-5f16ab571980 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:17.566977 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d75f000-0ca0-455f-92f6-5f16ab571980 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:17.567663 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d75f000-0ca0-455f-92f6-5f16ab571980 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:17.568113 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d75f000-0ca0-455f-92f6-5f16ab571980 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:17.568542 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7d75f000-0ca0-455f-92f6-5f16ab571980 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:17.701151 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-7d75f000-0ca0-455f-92f6-5f16ab571980 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:17.709887 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-7d75f000-0ca0-455f-92f6-5f16ab571980 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:17.711314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-7d75f000-0ca0-455f-92f6-5f16ab571980 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:17.712451 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7d75f000-0ca0-455f-92f6-5f16ab571980 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.158162 Oct 17 04:34:17.713558 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 201/407] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:34:17 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:34:18.238844 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-94713f44-313d-4c6d-8b3f-e04a82343daf req-862cf0d7-9700-411e-ade1-802bcad8d7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee04d43c-6d11-4571-989e-90ee8175e03d", "name": "network-vif-plugged", "status": "completed", "tag": "f63f40c8-b445-4c27-a582-2ac29415fbeb"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:34:18.249008 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-94713f44-313d-4c6d-8b3f-e04a82343daf req-862cf0d7-9700-411e-ade1-802bcad8d7b0 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:18.249514 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-94713f44-313d-4c6d-8b3f-e04a82343daf req-862cf0d7-9700-411e-ade1-802bcad8d7b0 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:18.249947 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-94713f44-313d-4c6d-8b3f-e04a82343daf req-862cf0d7-9700-411e-ade1-802bcad8d7b0 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:18.261439 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-94713f44-313d-4c6d-8b3f-e04a82343daf req-862cf0d7-9700-411e-ade1-802bcad8d7b0 service nova] Creating event network-vif-plugged:f63f40c8-b445-4c27-a582-2ac29415fbeb for instance ee04d43c-6d11-4571-989e-90ee8175e03d on hv-cinder-86155 Oct 17 04:34:18.266355 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-94713f44-313d-4c6d-8b3f-e04a82343daf req-862cf0d7-9700-411e-ade1-802bcad8d7b0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031190 Oct 17 04:34:18.266966 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 207/408] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:34:18.472504 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-18f308c9-fdf4-4693-acb7-1c28cc43f589 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:18.473028 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-18f308c9-fdf4-4693-acb7-1c28cc43f589 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:18.480889 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18f308c9-fdf4-4693-acb7-1c28cc43f589 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:18.481562 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18f308c9-fdf4-4693-acb7-1c28cc43f589 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:18.482037 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18f308c9-fdf4-4693-acb7-1c28cc43f589 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:18.483350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18f308c9-fdf4-4693-acb7-1c28cc43f589 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:18.483844 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18f308c9-fdf4-4693-acb7-1c28cc43f589 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:18.484264 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-18f308c9-fdf4-4693-acb7-1c28cc43f589 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:18.619657 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-18f308c9-fdf4-4693-acb7-1c28cc43f589 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:18.627720 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-18f308c9-fdf4-4693-acb7-1c28cc43f589 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.159305 Oct 17 04:34:18.628296 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 202/409] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:18 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:18.740848 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff1d3225-a222-4b4a-a6db-ed6f02bddc40 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:18.741493 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff1d3225-a222-4b4a-a6db-ed6f02bddc40 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:18.747594 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff1d3225-a222-4b4a-a6db-ed6f02bddc40 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:18.748073 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff1d3225-a222-4b4a-a6db-ed6f02bddc40 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:18.748505 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff1d3225-a222-4b4a-a6db-ed6f02bddc40 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:18.749225 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff1d3225-a222-4b4a-a6db-ed6f02bddc40 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:18.749677 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff1d3225-a222-4b4a-a6db-ed6f02bddc40 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:18.750102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff1d3225-a222-4b4a-a6db-ed6f02bddc40 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:18.888264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff1d3225-a222-4b4a-a6db-ed6f02bddc40 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:18.899236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff1d3225-a222-4b4a-a6db-ed6f02bddc40 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:18.900614 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff1d3225-a222-4b4a-a6db-ed6f02bddc40 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:18.902023 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff1d3225-a222-4b4a-a6db-ed6f02bddc40 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.166070 Oct 17 04:34:18.902653 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 208/410] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:34:18 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:34:19.563360 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0a4d761c-bf5e-4929-b02a-71ee85854d78 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:34:19.565756 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0a4d761c-bf5e-4929-b02a-71ee85854d78 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:19.572631 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a4d761c-bf5e-4929-b02a-71ee85854d78 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:19.573126 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a4d761c-bf5e-4929-b02a-71ee85854d78 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:19.573717 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a4d761c-bf5e-4929-b02a-71ee85854d78 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:19.574409 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a4d761c-bf5e-4929-b02a-71ee85854d78 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:19.574860 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a4d761c-bf5e-4929-b02a-71ee85854d78 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:19.575282 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a4d761c-bf5e-4929-b02a-71ee85854d78 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:19.598625 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-0a4d761c-bf5e-4929-b02a-71ee85854d78 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lazy-loading 'flavor' on Instance uuid e5722cf2-3e88-4c8e-a533-e6a228c13a82 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:34:19.602108 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:34:19.650421 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ba612864-1e36-4b14-bd71-f83316529351 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:19.651113 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ba612864-1e36-4b14-bd71-f83316529351 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:19.657472 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ba612864-1e36-4b14-bd71-f83316529351 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:19.657972 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ba612864-1e36-4b14-bd71-f83316529351 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:19.658403 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ba612864-1e36-4b14-bd71-f83316529351 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:19.659112 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ba612864-1e36-4b14-bd71-f83316529351 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:19.659560 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ba612864-1e36-4b14-bd71-f83316529351 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:19.659984 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ba612864-1e36-4b14-bd71-f83316529351 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:19.725937 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0a4d761c-bf5e-4929-b02a-71ee85854d78 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "POST /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82/action" status: 200 len: 32 microversion: 2.1 time: 0.166531 Oct 17 04:34:19.731453 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 203/411] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Oct 17 04:34:19 2022] POST /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 04:34:19.737328 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1fd2e013-40d1-484d-b26c-183564772e2b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:19.738183 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1fd2e013-40d1-484d-b26c-183564772e2b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:19.744851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fd2e013-40d1-484d-b26c-183564772e2b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:19.745605 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fd2e013-40d1-484d-b26c-183564772e2b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:19.746001 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fd2e013-40d1-484d-b26c-183564772e2b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:19.746700 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fd2e013-40d1-484d-b26c-183564772e2b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:19.747154 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fd2e013-40d1-484d-b26c-183564772e2b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:19.747586 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fd2e013-40d1-484d-b26c-183564772e2b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:19.801778 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-ba612864-1e36-4b14-bd71-f83316529351 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:19.810091 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ba612864-1e36-4b14-bd71-f83316529351 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.163533 Oct 17 04:34:19.810663 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 209/412] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:19 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:19.882477 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-1fd2e013-40d1-484d-b26c-183564772e2b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:19.891887 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1fd2e013-40d1-484d-b26c-183564772e2b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1734 microversion: 2.1 time: 0.158751 Oct 17 04:34:19.892660 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 204/413] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:19 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:34:19.928125 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bd7b61cd-f485-4e47-b801-fa33e64e812e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:19.928709 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bd7b61cd-f485-4e47-b801-fa33e64e812e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:19.935445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd7b61cd-f485-4e47-b801-fa33e64e812e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:19.935931 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd7b61cd-f485-4e47-b801-fa33e64e812e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:19.936365 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd7b61cd-f485-4e47-b801-fa33e64e812e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:19.937061 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd7b61cd-f485-4e47-b801-fa33e64e812e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:19.937538 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd7b61cd-f485-4e47-b801-fa33e64e812e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:19.937963 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bd7b61cd-f485-4e47-b801-fa33e64e812e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:20.077970 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-bd7b61cd-f485-4e47-b801-fa33e64e812e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:20.086846 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-bd7b61cd-f485-4e47-b801-fa33e64e812e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:20.088561 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-bd7b61cd-f485-4e47-b801-fa33e64e812e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:20.089762 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bd7b61cd-f485-4e47-b801-fa33e64e812e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.165627 Oct 17 04:34:20.090329 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 210/414] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:34:19 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:34:20.283197 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-c323d5a1-cc68-4140-a417-adf2949094b2 req-e8b311b5-b9af-473a-b931-2220dc8ce227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c04fcc98-6f6b-4092-ba63-364498327bb6", "name": "network-vif-plugged", "status": "completed", "tag": "5018bca9-d0fd-4019-a69a-d25003f4d4da"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:34:20.293611 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c323d5a1-cc68-4140-a417-adf2949094b2 req-e8b311b5-b9af-473a-b931-2220dc8ce227 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:20.294081 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c323d5a1-cc68-4140-a417-adf2949094b2 req-e8b311b5-b9af-473a-b931-2220dc8ce227 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:20.294506 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-c323d5a1-cc68-4140-a417-adf2949094b2 req-e8b311b5-b9af-473a-b931-2220dc8ce227 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:20.305065 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-c323d5a1-cc68-4140-a417-adf2949094b2 req-e8b311b5-b9af-473a-b931-2220dc8ce227 service nova] Creating event network-vif-plugged:5018bca9-d0fd-4019-a69a-d25003f4d4da for instance c04fcc98-6f6b-4092-ba63-364498327bb6 on hv-cinder-86155 Oct 17 04:34:20.310975 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-c323d5a1-cc68-4140-a417-adf2949094b2 req-e8b311b5-b9af-473a-b931-2220dc8ce227 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031442 Oct 17 04:34:20.311552 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 205/415] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:34:20.834197 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c95fca73-0718-4fc7-b4f4-8000ebf044f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:20.834873 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c95fca73-0718-4fc7-b4f4-8000ebf044f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:20.841125 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c95fca73-0718-4fc7-b4f4-8000ebf044f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:20.841692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c95fca73-0718-4fc7-b4f4-8000ebf044f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:20.842199 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c95fca73-0718-4fc7-b4f4-8000ebf044f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:20.842979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c95fca73-0718-4fc7-b4f4-8000ebf044f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:20.843503 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c95fca73-0718-4fc7-b4f4-8000ebf044f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:20.844129 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c95fca73-0718-4fc7-b4f4-8000ebf044f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:20.919120 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d6b6c9bc-6a0a-4960-b0d2-0da00d712fb0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:20.920144 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d6b6c9bc-6a0a-4960-b0d2-0da00d712fb0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:20.927928 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6b6c9bc-6a0a-4960-b0d2-0da00d712fb0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:20.928345 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6b6c9bc-6a0a-4960-b0d2-0da00d712fb0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:20.929195 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6b6c9bc-6a0a-4960-b0d2-0da00d712fb0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:20.930092 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6b6c9bc-6a0a-4960-b0d2-0da00d712fb0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:20.930545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6b6c9bc-6a0a-4960-b0d2-0da00d712fb0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:20.930967 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6b6c9bc-6a0a-4960-b0d2-0da00d712fb0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:20.996013 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c95fca73-0718-4fc7-b4f4-8000ebf044f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:21.004416 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c95fca73-0718-4fc7-b4f4-8000ebf044f4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.174727 Oct 17 04:34:21.018507 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 211/416] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:20 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:21.095616 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d6b6c9bc-6a0a-4960-b0d2-0da00d712fb0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:21.106300 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d6b6c9bc-6a0a-4960-b0d2-0da00d712fb0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1734 microversion: 2.1 time: 0.193980 Oct 17 04:34:21.106893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 206/417] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:20 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1734 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:21.125998 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-17e79aac-3255-47fb-ae6d-f9d78b929cee tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:21.126787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-17e79aac-3255-47fb-ae6d-f9d78b929cee tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:21.133739 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17e79aac-3255-47fb-ae6d-f9d78b929cee tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:21.134383 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17e79aac-3255-47fb-ae6d-f9d78b929cee tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:21.135589 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17e79aac-3255-47fb-ae6d-f9d78b929cee tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:21.136564 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17e79aac-3255-47fb-ae6d-f9d78b929cee tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:21.137156 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17e79aac-3255-47fb-ae6d-f9d78b929cee tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:21.137794 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-17e79aac-3255-47fb-ae6d-f9d78b929cee tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:21.142681 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:34:21.284675 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-17e79aac-3255-47fb-ae6d-f9d78b929cee tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:21.293522 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-17e79aac-3255-47fb-ae6d-f9d78b929cee tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:21.294983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-17e79aac-3255-47fb-ae6d-f9d78b929cee tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:21.296140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-17e79aac-3255-47fb-ae6d-f9d78b929cee tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1807 microversion: 2.20 time: 0.182184 Oct 17 04:34:21.296698 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 212/418] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:34:21 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:34:22.030978 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ec3d3cba-80ca-4e03-a25a-1ebc01f3293a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:22.031589 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ec3d3cba-80ca-4e03-a25a-1ebc01f3293a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:22.038038 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ec3d3cba-80ca-4e03-a25a-1ebc01f3293a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:22.038523 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ec3d3cba-80ca-4e03-a25a-1ebc01f3293a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:22.038951 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ec3d3cba-80ca-4e03-a25a-1ebc01f3293a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:22.039645 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ec3d3cba-80ca-4e03-a25a-1ebc01f3293a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:22.040096 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ec3d3cba-80ca-4e03-a25a-1ebc01f3293a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:22.040520 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ec3d3cba-80ca-4e03-a25a-1ebc01f3293a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:22.129904 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4a4cd002-7836-4aa1-ab95-7b1e0826a6fc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:22.130517 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4a4cd002-7836-4aa1-ab95-7b1e0826a6fc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:22.137061 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a4cd002-7836-4aa1-ab95-7b1e0826a6fc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:22.137818 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a4cd002-7836-4aa1-ab95-7b1e0826a6fc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:22.138254 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a4cd002-7836-4aa1-ab95-7b1e0826a6fc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:22.138958 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a4cd002-7836-4aa1-ab95-7b1e0826a6fc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:22.139411 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a4cd002-7836-4aa1-ab95-7b1e0826a6fc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:22.139833 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a4cd002-7836-4aa1-ab95-7b1e0826a6fc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:22.174150 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-ec3d3cba-80ca-4e03-a25a-1ebc01f3293a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:22.181779 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ec3d3cba-80ca-4e03-a25a-1ebc01f3293a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.154667 Oct 17 04:34:22.182355 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 207/419] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:22 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:22.267092 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-4a4cd002-7836-4aa1-ab95-7b1e0826a6fc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:22.275195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4a4cd002-7836-4aa1-ab95-7b1e0826a6fc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1734 microversion: 2.1 time: 0.149015 Oct 17 04:34:22.276503 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 213/420] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:22 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:34:22.321991 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-97b65f18-fca1-439e-b0f0-eb15e19d308f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:22.323132 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-97b65f18-fca1-439e-b0f0-eb15e19d308f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:22.329183 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97b65f18-fca1-439e-b0f0-eb15e19d308f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:22.329668 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97b65f18-fca1-439e-b0f0-eb15e19d308f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:22.330104 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97b65f18-fca1-439e-b0f0-eb15e19d308f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:22.330789 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97b65f18-fca1-439e-b0f0-eb15e19d308f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:22.331238 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97b65f18-fca1-439e-b0f0-eb15e19d308f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:22.331656 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-97b65f18-fca1-439e-b0f0-eb15e19d308f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:22.458397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-97b65f18-fca1-439e-b0f0-eb15e19d308f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:22.467431 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-97b65f18-fca1-439e-b0f0-eb15e19d308f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:22.468914 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-97b65f18-fca1-439e-b0f0-eb15e19d308f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:22.470097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-97b65f18-fca1-439e-b0f0-eb15e19d308f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1794 microversion: 2.20 time: 0.152001 Oct 17 04:34:22.470652 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 208/421] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:34:22 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1794 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:34:23.206374 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dcf96714-05bf-47e7-b47e-3437b7a4893e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:23.206974 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dcf96714-05bf-47e7-b47e-3437b7a4893e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:23.213288 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dcf96714-05bf-47e7-b47e-3437b7a4893e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:23.213766 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dcf96714-05bf-47e7-b47e-3437b7a4893e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:23.214195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dcf96714-05bf-47e7-b47e-3437b7a4893e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:23.214885 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dcf96714-05bf-47e7-b47e-3437b7a4893e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:23.215342 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dcf96714-05bf-47e7-b47e-3437b7a4893e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:23.215752 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dcf96714-05bf-47e7-b47e-3437b7a4893e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:23.298867 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d6f66f56-8f8b-4b43-856f-b1ca204387dd tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:23.299483 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d6f66f56-8f8b-4b43-856f-b1ca204387dd tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:23.306086 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6f66f56-8f8b-4b43-856f-b1ca204387dd tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:23.307246 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6f66f56-8f8b-4b43-856f-b1ca204387dd tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:23.307720 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6f66f56-8f8b-4b43-856f-b1ca204387dd tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:23.308416 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6f66f56-8f8b-4b43-856f-b1ca204387dd tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:23.308871 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6f66f56-8f8b-4b43-856f-b1ca204387dd tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:23.309314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d6f66f56-8f8b-4b43-856f-b1ca204387dd tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:23.365297 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-dcf96714-05bf-47e7-b47e-3437b7a4893e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:23.373525 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dcf96714-05bf-47e7-b47e-3437b7a4893e tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1260 microversion: 2.1 time: 0.171238 Oct 17 04:34:23.374098 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 214/422] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:23 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:23.447393 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d6f66f56-8f8b-4b43-856f-b1ca204387dd tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:23.455819 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d6f66f56-8f8b-4b43-856f-b1ca204387dd tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1734 microversion: 2.1 time: 0.160776 Oct 17 04:34:23.456395 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 209/423] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:23 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:34:24.395858 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5ef29cba-f0c4-4122-b625-6c1267c3f1c1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:24.396471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5ef29cba-f0c4-4122-b625-6c1267c3f1c1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:24.403647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ef29cba-f0c4-4122-b625-6c1267c3f1c1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:24.404130 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ef29cba-f0c4-4122-b625-6c1267c3f1c1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:24.404569 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ef29cba-f0c4-4122-b625-6c1267c3f1c1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:24.405292 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ef29cba-f0c4-4122-b625-6c1267c3f1c1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:24.405746 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ef29cba-f0c4-4122-b625-6c1267c3f1c1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:24.406174 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ef29cba-f0c4-4122-b625-6c1267c3f1c1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:24.482624 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fcb77d9c-970e-472d-9219-89700cbf33ab tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:24.483839 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fcb77d9c-970e-472d-9219-89700cbf33ab tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:24.491365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcb77d9c-970e-472d-9219-89700cbf33ab tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:24.492024 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcb77d9c-970e-472d-9219-89700cbf33ab tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:24.492542 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcb77d9c-970e-472d-9219-89700cbf33ab tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:24.493349 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcb77d9c-970e-472d-9219-89700cbf33ab tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:24.493897 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcb77d9c-970e-472d-9219-89700cbf33ab tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:24.494408 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcb77d9c-970e-472d-9219-89700cbf33ab tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:24.548623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5ef29cba-f0c4-4122-b625-6c1267c3f1c1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:24.556382 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5ef29cba-f0c4-4122-b625-6c1267c3f1c1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1443 microversion: 2.1 time: 0.164482 Oct 17 04:34:24.557224 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 215/424] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:24 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:24.580096 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a8931356-541f-4edc-bb97-5267fa819f3a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:24.580711 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a8931356-541f-4edc-bb97-5267fa819f3a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:24.586558 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8931356-541f-4edc-bb97-5267fa819f3a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:24.587048 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8931356-541f-4edc-bb97-5267fa819f3a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:24.587489 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8931356-541f-4edc-bb97-5267fa819f3a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:24.589587 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8931356-541f-4edc-bb97-5267fa819f3a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:24.590057 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8931356-541f-4edc-bb97-5267fa819f3a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:24.590490 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a8931356-541f-4edc-bb97-5267fa819f3a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:24.641101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-fcb77d9c-970e-472d-9219-89700cbf33ab tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:24.650967 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fcb77d9c-970e-472d-9219-89700cbf33ab tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1734 microversion: 2.1 time: 0.173107 Oct 17 04:34:24.657130 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 210/425] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:24 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:24.726019 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a8931356-541f-4edc-bb97-5267fa819f3a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:24.733869 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a8931356-541f-4edc-bb97-5267fa819f3a tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1443 microversion: 2.1 time: 0.157777 Oct 17 04:34:24.734441 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 216/426] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:24 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:34:25.675064 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f9c78e3f-7d08-4d84-9363-80f07c6e45fe tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:25.675711 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f9c78e3f-7d08-4d84-9363-80f07c6e45fe tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:25.682440 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9c78e3f-7d08-4d84-9363-80f07c6e45fe tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:25.682930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9c78e3f-7d08-4d84-9363-80f07c6e45fe tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:25.683365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9c78e3f-7d08-4d84-9363-80f07c6e45fe tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:25.684199 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9c78e3f-7d08-4d84-9363-80f07c6e45fe tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:25.684800 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9c78e3f-7d08-4d84-9363-80f07c6e45fe tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:25.685263 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f9c78e3f-7d08-4d84-9363-80f07c6e45fe tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:25.879470 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f9c78e3f-7d08-4d84-9363-80f07c6e45fe tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:25.892057 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f9c78e3f-7d08-4d84-9363-80f07c6e45fe tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1734 microversion: 2.1 time: 0.220610 Oct 17 04:34:25.893146 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 211/427] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:25 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1734 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:34:26.778547 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-fd6e372e-3644-4549-ba1c-043502b91759 req-4b53b2a6-d86e-4c7a-b841-8d5ffeaeaf39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c04fcc98-6f6b-4092-ba63-364498327bb6", "tag": "5018bca9-d0fd-4019-a69a-d25003f4d4da"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:34:26.788254 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fd6e372e-3644-4549-ba1c-043502b91759 req-4b53b2a6-d86e-4c7a-b841-8d5ffeaeaf39 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:26.788734 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fd6e372e-3644-4549-ba1c-043502b91759 req-4b53b2a6-d86e-4c7a-b841-8d5ffeaeaf39 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:26.789199 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fd6e372e-3644-4549-ba1c-043502b91759 req-4b53b2a6-d86e-4c7a-b841-8d5ffeaeaf39 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:26.801196 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-fd6e372e-3644-4549-ba1c-043502b91759 req-4b53b2a6-d86e-4c7a-b841-8d5ffeaeaf39 service nova] Creating event network-changed:5018bca9-d0fd-4019-a69a-d25003f4d4da for instance c04fcc98-6f6b-4092-ba63-364498327bb6 on hv-cinder-86155 Oct 17 04:34:26.806240 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-fd6e372e-3644-4549-ba1c-043502b91759 req-4b53b2a6-d86e-4c7a-b841-8d5ffeaeaf39 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031542 Oct 17 04:34:26.807441 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 217/428] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:34:26.916888 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bbb444fe-0ee7-4ca6-9a1a-c06b334182db tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:26.918270 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bbb444fe-0ee7-4ca6-9a1a-c06b334182db tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:26.925127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbb444fe-0ee7-4ca6-9a1a-c06b334182db tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:26.925607 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbb444fe-0ee7-4ca6-9a1a-c06b334182db tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:26.926263 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbb444fe-0ee7-4ca6-9a1a-c06b334182db tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:26.926949 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbb444fe-0ee7-4ca6-9a1a-c06b334182db tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:26.927553 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbb444fe-0ee7-4ca6-9a1a-c06b334182db tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:26.928143 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bbb444fe-0ee7-4ca6-9a1a-c06b334182db tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:27.068603 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-bbb444fe-0ee7-4ca6-9a1a-c06b334182db tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:27.078067 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bbb444fe-0ee7-4ca6-9a1a-c06b334182db tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1734 microversion: 2.1 time: 0.165240 Oct 17 04:34:27.084600 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 212/429] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:26 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:28.102117 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-455f0090-faef-4973-be70-c4524055a67d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:28.102806 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-455f0090-faef-4973-be70-c4524055a67d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:28.108876 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-455f0090-faef-4973-be70-c4524055a67d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:28.109386 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-455f0090-faef-4973-be70-c4524055a67d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:28.109816 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-455f0090-faef-4973-be70-c4524055a67d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:28.110496 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-455f0090-faef-4973-be70-c4524055a67d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:28.110940 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-455f0090-faef-4973-be70-c4524055a67d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:28.111359 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-455f0090-faef-4973-be70-c4524055a67d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:28.238739 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-455f0090-faef-4973-be70-c4524055a67d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:28.248543 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-455f0090-faef-4973-be70-c4524055a67d tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1734 microversion: 2.1 time: 0.151162 Oct 17 04:34:28.249128 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 218/430] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:28 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:29.271439 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d53d9423-54b2-438d-a1bc-3567418fb7e8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:29.272156 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d53d9423-54b2-438d-a1bc-3567418fb7e8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:29.279438 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d53d9423-54b2-438d-a1bc-3567418fb7e8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:29.279922 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d53d9423-54b2-438d-a1bc-3567418fb7e8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:29.280360 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d53d9423-54b2-438d-a1bc-3567418fb7e8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:29.281056 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d53d9423-54b2-438d-a1bc-3567418fb7e8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:29.281541 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d53d9423-54b2-438d-a1bc-3567418fb7e8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:29.282075 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d53d9423-54b2-438d-a1bc-3567418fb7e8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:29.416358 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d53d9423-54b2-438d-a1bc-3567418fb7e8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:29.424485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d53d9423-54b2-438d-a1bc-3567418fb7e8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1734 microversion: 2.1 time: 0.156974 Oct 17 04:34:29.425053 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 213/431] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:29 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:30.449439 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1493d8e0-69aa-47d6-9e72-72a9eeb7981e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:30.450914 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1493d8e0-69aa-47d6-9e72-72a9eeb7981e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:30.457659 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=56 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:34:30.460160 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1493d8e0-69aa-47d6-9e72-72a9eeb7981e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:30.460778 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1493d8e0-69aa-47d6-9e72-72a9eeb7981e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:30.461524 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1493d8e0-69aa-47d6-9e72-72a9eeb7981e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:30.463008 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1493d8e0-69aa-47d6-9e72-72a9eeb7981e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:30.463578 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1493d8e0-69aa-47d6-9e72-72a9eeb7981e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:30.464256 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1493d8e0-69aa-47d6-9e72-72a9eeb7981e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:30.603959 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-1493d8e0-69aa-47d6-9e72-72a9eeb7981e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:30.612237 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1493d8e0-69aa-47d6-9e72-72a9eeb7981e tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1734 microversion: 2.1 time: 0.168284 Oct 17 04:34:30.612916 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 219/432] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:30 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:34:31.635679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c00b8ec2-32ee-4a76-94ab-d4d57f806f5c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:31.636289 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c00b8ec2-32ee-4a76-94ab-d4d57f806f5c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:31.642787 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c00b8ec2-32ee-4a76-94ab-d4d57f806f5c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:31.643270 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c00b8ec2-32ee-4a76-94ab-d4d57f806f5c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:31.643704 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c00b8ec2-32ee-4a76-94ab-d4d57f806f5c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:31.644391 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c00b8ec2-32ee-4a76-94ab-d4d57f806f5c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:31.644841 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c00b8ec2-32ee-4a76-94ab-d4d57f806f5c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:31.645298 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c00b8ec2-32ee-4a76-94ab-d4d57f806f5c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:31.778754 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-c00b8ec2-32ee-4a76-94ab-d4d57f806f5c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:31.786880 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c00b8ec2-32ee-4a76-94ab-d4d57f806f5c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1734 microversion: 2.1 time: 0.155302 Oct 17 04:34:31.787443 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 214/433] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:31 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:32.811182 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-75411ff8-604f-4290-9e1a-793f2cc92181 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:32.811837 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-75411ff8-604f-4290-9e1a-793f2cc92181 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:32.818192 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75411ff8-604f-4290-9e1a-793f2cc92181 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:32.818669 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75411ff8-604f-4290-9e1a-793f2cc92181 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:32.819103 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75411ff8-604f-4290-9e1a-793f2cc92181 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:32.819784 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75411ff8-604f-4290-9e1a-793f2cc92181 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:32.820234 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75411ff8-604f-4290-9e1a-793f2cc92181 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:32.820656 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75411ff8-604f-4290-9e1a-793f2cc92181 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:32.950526 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-75411ff8-604f-4290-9e1a-793f2cc92181 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:32.959156 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-75411ff8-604f-4290-9e1a-793f2cc92181 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1734 microversion: 2.1 time: 0.151837 Oct 17 04:34:32.959734 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 220/434] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:32 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:33.178568 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a3f1e21d-cac3-499c-afd7-217109271f61 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:33.179079 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a3f1e21d-cac3-499c-afd7-217109271f61 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:33.181677 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=54 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:34:33.186883 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3f1e21d-cac3-499c-afd7-217109271f61 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:33.187363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3f1e21d-cac3-499c-afd7-217109271f61 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:33.187799 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3f1e21d-cac3-499c-afd7-217109271f61 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:33.188492 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3f1e21d-cac3-499c-afd7-217109271f61 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:33.188944 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3f1e21d-cac3-499c-afd7-217109271f61 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:33.189393 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3f1e21d-cac3-499c-afd7-217109271f61 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:33.216393 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a3f1e21d-cac3-499c-afd7-217109271f61 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be/ips" status: 200 len: 149 microversion: 2.1 time: 0.041696 Oct 17 04:34:33.216969 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 215/435] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Oct 17 04:34:33 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:34:33.229144 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-002439a9-d3fc-4cc2-81c7-765caed40eff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea058293-ae48-45f4-b2da-73f9230fdef1"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:34:33.231500 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-002439a9-d3fc-4cc2-81c7-765caed40eff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:33.237410 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-002439a9-d3fc-4cc2-81c7-765caed40eff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:33.237893 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-002439a9-d3fc-4cc2-81c7-765caed40eff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:33.238319 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-002439a9-d3fc-4cc2-81c7-765caed40eff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:33.239182 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-002439a9-d3fc-4cc2-81c7-765caed40eff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:33.239631 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-002439a9-d3fc-4cc2-81c7-765caed40eff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:33.240046 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-002439a9-d3fc-4cc2-81c7-765caed40eff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:33.323895 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-002439a9-d3fc-4cc2-81c7-765caed40eff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] HTTP exception thrown: Invalid volume: volume ea058293-ae48-45f4-b2da-73f9230fdef1 is already attached to instances: ffc759c8-a208-4df1-bf3e-dd2b89bff369 Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-002439a9-d3fc-4cc2-81c7-765caed40eff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Request method failure captured: Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: POST /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be/os-volume_attachments HTTP/1.1 Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 74 Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNqRI5416bQSxgt6AXPotC0ZA8EQSE7l65zNcTm_mxUo9wFNmkuLDOKI-_C3Raae9FpamLQxUS44gziCftz35IAzDjSECza3w5spd_jxIdlfyyzXpOJTef9rLRzMW0mp2HVcK15b4ajr4hc5Lz_I9yQNIKfhl18_NwaTHORpu95fjDE Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:34:33.325650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:34:33.327081 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e022e6125e85417881ce226db7a5c764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e022e6125e85417881ce226db7a5c764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:34:33.327081 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:34:33.327081 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:34:33.327081 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:34:33.327081 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:34:33.327081 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:34:33.327081 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:34:33.327081 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 59aa96241a8e4d9db6d255c38f618ca1 Oct 17 04:34:33.327081 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:34:33.327081 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Oct 17 04:34:33.327081 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {"volumeAttachment": {"volumeId": "ea058293-ae48-45f4-b2da-73f9230fdef1"}} Oct 17 04:34:33.327081 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:34:33.328276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Invalid volume: volume ea058293-ae48-45f4-b2da-73f9230fdef1 is already attached to instances: ffc759c8-a208-4df1-bf3e-dd2b89bff369 Oct 17 04:34:33.328276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'server_id': '77752d3b-6577-45d9-b7f4-1bca4ee444be', 'body': {'volumeAttachment': {'volumeId': 'ea058293-ae48-45f4-b2da-73f9230fdef1'}}} Oct 17 04:34:33.328276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:34:33.328276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:34:33.328276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 04:34:33.328276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 04:34:33.328276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 04:34:33.328276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 04:34:33.328276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 04:34:33.328276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 04:34:33.328276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 04:34:33.328276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 04:34:33.328276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 04:34:33.328276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 04:34:33.328276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ea058293-ae48-45f4-b2da-73f9230fdef1 is already attached to instances: ffc759c8-a208-4df1-bf3e-dd2b89bff369 Oct 17 04:34:33.328276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:34:33.328276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:34:33.328276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:34:33.328276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ea058293-ae48-45f4-b2da-73f9230fdef1 is already attached to instances: ffc759c8-a208-4df1-bf3e-dd2b89bff369 Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:34:33.329903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:34:33.331583 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:34:33.331583 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:34:33.331583 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:34:33.331583 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ea058293-ae48-45f4-b2da-73f9230fdef1 is already attached to instances: ffc759c8-a208-4df1-bf3e-dd2b89bff369 Oct 17 04:34:33.331583 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:34:33.331583 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-002439a9-d3fc-4cc2-81c7-765caed40eff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Returning 400 to user: Invalid volume: volume ea058293-ae48-45f4-b2da-73f9230fdef1 is already attached to instances: ffc759c8-a208-4df1-bf3e-dd2b89bff369 {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:34:33.331583 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-002439a9-d3fc-4cc2-81c7-765caed40eff tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "POST /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102643 Oct 17 04:34:33.331583 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 221/436] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Oct 17 04:34:33 2022] POST /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 04:34:33.336307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-378a2c6f-ebda-4477-bf00-7940e603e9e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:33.336823 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-378a2c6f-ebda-4477-bf00-7940e603e9e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:33.342961 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-378a2c6f-ebda-4477-bf00-7940e603e9e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:33.343443 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-378a2c6f-ebda-4477-bf00-7940e603e9e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:33.343876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-378a2c6f-ebda-4477-bf00-7940e603e9e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:33.344560 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-378a2c6f-ebda-4477-bf00-7940e603e9e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:33.345008 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-378a2c6f-ebda-4477-bf00-7940e603e9e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:33.345465 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-378a2c6f-ebda-4477-bf00-7940e603e9e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:33.370169 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-378a2c6f-ebda-4477-bf00-7940e603e9e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:34:33.444620 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-378a2c6f-ebda-4477-bf00-7940e603e9e2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "DELETE /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 204 len: 0 microversion: 2.1 time: 0.111748 Oct 17 04:34:33.445470 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 216/437] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:34:33 2022] DELETE /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:34:33.455980 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c4eed3f3-19f2-4f87-9e66-9feec4983d79 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:33.456595 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c4eed3f3-19f2-4f87-9e66-9feec4983d79 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:33.463696 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4eed3f3-19f2-4f87-9e66-9feec4983d79 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:33.464179 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4eed3f3-19f2-4f87-9e66-9feec4983d79 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:33.464608 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4eed3f3-19f2-4f87-9e66-9feec4983d79 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:33.465357 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4eed3f3-19f2-4f87-9e66-9feec4983d79 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:33.465793 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4eed3f3-19f2-4f87-9e66-9feec4983d79 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:33.466213 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c4eed3f3-19f2-4f87-9e66-9feec4983d79 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:33.592443 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c4eed3f3-19f2-4f87-9e66-9feec4983d79 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:33.600093 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c4eed3f3-19f2-4f87-9e66-9feec4983d79 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1681 microversion: 2.1 time: 0.148525 Oct 17 04:34:33.600642 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 222/438] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:33 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:33.984516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2d0a4c25-1b95-446d-843d-ce67d6f4c3dc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:33.985236 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2d0a4c25-1b95-446d-843d-ce67d6f4c3dc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:33.991237 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2d0a4c25-1b95-446d-843d-ce67d6f4c3dc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:33.991719 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2d0a4c25-1b95-446d-843d-ce67d6f4c3dc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:33.992153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2d0a4c25-1b95-446d-843d-ce67d6f4c3dc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:33.992838 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2d0a4c25-1b95-446d-843d-ce67d6f4c3dc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:33.993316 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2d0a4c25-1b95-446d-843d-ce67d6f4c3dc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:33.993737 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2d0a4c25-1b95-446d-843d-ce67d6f4c3dc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:34.123386 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-2d0a4c25-1b95-446d-843d-ce67d6f4c3dc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:34.125715 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:34:34.131396 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2d0a4c25-1b95-446d-843d-ce67d6f4c3dc tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1734 microversion: 2.1 time: 0.151129 Oct 17 04:34:34.131972 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 217/439] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:33 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:34.624462 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d0c7895c-cee4-4b80-8d65-4755939af1c5 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:34.625083 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d0c7895c-cee4-4b80-8d65-4755939af1c5 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:34.632704 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0c7895c-cee4-4b80-8d65-4755939af1c5 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:34.633229 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0c7895c-cee4-4b80-8d65-4755939af1c5 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:34.633675 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0c7895c-cee4-4b80-8d65-4755939af1c5 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:34.634370 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0c7895c-cee4-4b80-8d65-4755939af1c5 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:34.635468 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0c7895c-cee4-4b80-8d65-4755939af1c5 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:34.635904 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d0c7895c-cee4-4b80-8d65-4755939af1c5 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:34.761856 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-d0c7895c-cee4-4b80-8d65-4755939af1c5 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:34.772495 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d0c7895c-cee4-4b80-8d65-4755939af1c5 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1681 microversion: 2.1 time: 0.151891 Oct 17 04:34:34.773516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 223/440] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:34 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:35.156239 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f37ba564-0883-4990-89d3-ecc01c60f93c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:35.156755 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f37ba564-0883-4990-89d3-ecc01c60f93c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:35.164009 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f37ba564-0883-4990-89d3-ecc01c60f93c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:35.164490 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f37ba564-0883-4990-89d3-ecc01c60f93c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:35.164921 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f37ba564-0883-4990-89d3-ecc01c60f93c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:35.165634 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f37ba564-0883-4990-89d3-ecc01c60f93c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:35.167194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f37ba564-0883-4990-89d3-ecc01c60f93c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:35.167630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f37ba564-0883-4990-89d3-ecc01c60f93c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:35.298838 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f37ba564-0883-4990-89d3-ecc01c60f93c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:35.307653 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f37ba564-0883-4990-89d3-ecc01c60f93c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1734 microversion: 2.1 time: 0.156029 Oct 17 04:34:35.319487 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 218/441] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:35 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:34:35.796197 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-56d345cf-2562-46af-957f-b77314299acc tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:35.796883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-56d345cf-2562-46af-957f-b77314299acc tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:35.803281 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56d345cf-2562-46af-957f-b77314299acc tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:35.803704 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56d345cf-2562-46af-957f-b77314299acc tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:35.804142 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56d345cf-2562-46af-957f-b77314299acc tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:35.804840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56d345cf-2562-46af-957f-b77314299acc tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:35.805321 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56d345cf-2562-46af-957f-b77314299acc tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:35.805749 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56d345cf-2562-46af-957f-b77314299acc tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:35.870619 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-56d345cf-2562-46af-957f-b77314299acc tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:35.878707 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-56d345cf-2562-46af-957f-b77314299acc tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 200 len: 1613 microversion: 2.1 time: 0.086450 Oct 17 04:34:35.879280 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 224/442] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:35 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 1613 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:36.006350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-8cc3f777-633b-4aba-8aa4-a747dd4fde67 req-344a8d71-d562-4e9a-a117-495b48688625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77752d3b-6577-45d9-b7f4-1bca4ee444be", "name": "network-vif-deleted", "tag": "68d2f18e-a6e0-4ab3-8073-de5deb76b4d2"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:34:36.020478 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8cc3f777-633b-4aba-8aa4-a747dd4fde67 req-344a8d71-d562-4e9a-a117-495b48688625 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:36.020963 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8cc3f777-633b-4aba-8aa4-a747dd4fde67 req-344a8d71-d562-4e9a-a117-495b48688625 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:36.021423 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-8cc3f777-633b-4aba-8aa4-a747dd4fde67 req-344a8d71-d562-4e9a-a117-495b48688625 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:36.038096 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-8cc3f777-633b-4aba-8aa4-a747dd4fde67 req-344a8d71-d562-4e9a-a117-495b48688625 service nova] Creating event network-vif-deleted:68d2f18e-a6e0-4ab3-8073-de5deb76b4d2 for instance 77752d3b-6577-45d9-b7f4-1bca4ee444be on hv-cinder-86155 Oct 17 04:34:36.043507 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-8cc3f777-633b-4aba-8aa4-a747dd4fde67 req-344a8d71-d562-4e9a-a117-495b48688625 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040925 Oct 17 04:34:36.044117 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 219/443] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:34:36.332417 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f839881e-7d35-432b-ae43-31dc6f5608c2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:36.333212 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f839881e-7d35-432b-ae43-31dc6f5608c2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:36.341252 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f839881e-7d35-432b-ae43-31dc6f5608c2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:36.341755 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f839881e-7d35-432b-ae43-31dc6f5608c2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:36.342697 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f839881e-7d35-432b-ae43-31dc6f5608c2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:36.345953 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f839881e-7d35-432b-ae43-31dc6f5608c2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:36.346633 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f839881e-7d35-432b-ae43-31dc6f5608c2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:36.347259 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f839881e-7d35-432b-ae43-31dc6f5608c2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:36.495944 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f839881e-7d35-432b-ae43-31dc6f5608c2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:36.505856 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f839881e-7d35-432b-ae43-31dc6f5608c2 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1734 microversion: 2.1 time: 0.177909 Oct 17 04:34:36.506453 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 225/444] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:36 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:36.904139 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6f8f13f5-0faa-4645-bf39-31e0bdbd0e9b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:36.905682 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6f8f13f5-0faa-4645-bf39-31e0bdbd0e9b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:36.913229 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f8f13f5-0faa-4645-bf39-31e0bdbd0e9b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:36.913730 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f8f13f5-0faa-4645-bf39-31e0bdbd0e9b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:36.914262 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f8f13f5-0faa-4645-bf39-31e0bdbd0e9b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:36.914972 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f8f13f5-0faa-4645-bf39-31e0bdbd0e9b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:36.915460 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f8f13f5-0faa-4645-bf39-31e0bdbd0e9b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:36.916087 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6f8f13f5-0faa-4645-bf39-31e0bdbd0e9b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:36.930681 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-6f8f13f5-0faa-4645-bf39-31e0bdbd0e9b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] HTTP exception thrown: Instance 77752d3b-6577-45d9-b7f4-1bca4ee444be could not be found. Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6f8f13f5-0faa-4645-bf39-31e0bdbd0e9b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Request method failure captured: Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be HTTP/1.1 Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNqRI5416bQSxgt6AXPotC0ZA8EQSE7l65zNcTm_mxUo9wFNmkuLDOKI-_C3Raae9FpamLQxUS44gziCftz35IAzDjSECza3w5spd_jxIdlfyyzXpOJTef9rLRzMW0mp2HVcK15b4ajr4hc5Lz_I9yQNIKfhl18_NwaTHORpu95fjDE Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:34:36.933516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:34:36.934878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e022e6125e85417881ce226db7a5c764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e022e6125e85417881ce226db7a5c764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:34:36.934878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:34:36.934878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:34:36.934878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:34:36.934878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:34:36.934878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:34:36.934878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:34:36.934878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: 59aa96241a8e4d9db6d255c38f618ca1 Oct 17 04:34:36.934878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:34:36.934878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:34:36.934878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance 77752d3b-6577-45d9-b7f4-1bca4ee444be could not be found. Oct 17 04:34:36.934878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': '77752d3b-6577-45d9-b7f4-1bca4ee444be'} Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77752d3b-6577-45d9-b7f4-1bca4ee444be could not be found. Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:34:36.935746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:34:36.940314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:34:36.940314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:34:36.940314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:34:36.940314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:34:36.940314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:34:36.940314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:34:36.940314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:34:36.940314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77752d3b-6577-45d9-b7f4-1bca4ee444be could not be found. Oct 17 04:34:36.940314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:34:36.940314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:34:36.940314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:34:36.940314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:34:36.940314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:34:36.940314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:34:36.940314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:34:36.940314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:34:36.940314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77752d3b-6577-45d9-b7f4-1bca4ee444be could not be found. Oct 17 04:34:36.940314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:34:36.941499 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6f8f13f5-0faa-4645-bf39-31e0bdbd0e9b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Returning 404 to user: Instance 77752d3b-6577-45d9-b7f4-1bca4ee444be could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:34:36.941499 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6f8f13f5-0faa-4645-bf39-31e0bdbd0e9b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 404 len: 111 microversion: 2.1 time: 0.035390 Oct 17 04:34:36.941499 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 220/445] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:36 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:34:36.944433 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cf19e3e0-b597-496a-ad7e-1d0b3c4df361 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '.version_select at 0x7fc630dcbd30>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:36.969067 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cf19e3e0-b597-496a-ad7e-1d0b3c4df361 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893884471" status: 202 len: 0 microversion: 2.1 time: 0.028338 Oct 17 04:34:36.970038 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 226/446] 10.222.0.40 () {58 vars in 1221 bytes} [Mon Oct 17 04:34:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893884471 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:34:37.530024 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-92429f5d-6317-4ade-ad04-87982b0f3dd9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:37.530911 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-92429f5d-6317-4ade-ad04-87982b0f3dd9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:37.537374 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92429f5d-6317-4ade-ad04-87982b0f3dd9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:37.537940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92429f5d-6317-4ade-ad04-87982b0f3dd9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:37.538530 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92429f5d-6317-4ade-ad04-87982b0f3dd9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:37.539309 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92429f5d-6317-4ade-ad04-87982b0f3dd9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:37.540007 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92429f5d-6317-4ade-ad04-87982b0f3dd9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:37.540534 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-92429f5d-6317-4ade-ad04-87982b0f3dd9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:37.674117 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-92429f5d-6317-4ade-ad04-87982b0f3dd9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:37.682856 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-92429f5d-6317-4ade-ad04-87982b0f3dd9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1734 microversion: 2.1 time: 0.157017 Oct 17 04:34:37.683550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 221/447] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:37 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:37.719521 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-07415cf4-2112-4101-97ca-04945a86ce65 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:37.720022 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-07415cf4-2112-4101-97ca-04945a86ce65 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:37.727140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-07415cf4-2112-4101-97ca-04945a86ce65 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:37.728005 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-07415cf4-2112-4101-97ca-04945a86ce65 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:37.729408 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-07415cf4-2112-4101-97ca-04945a86ce65 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:37.730387 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-07415cf4-2112-4101-97ca-04945a86ce65 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:37.731084 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-07415cf4-2112-4101-97ca-04945a86ce65 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:37.731738 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-07415cf4-2112-4101-97ca-04945a86ce65 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:37.895708 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-07415cf4-2112-4101-97ca-04945a86ce65 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lazy-loading 'services' on Instance uuid bf59bfb1-79b1-4ebe-9635-380231dec617 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:34:37.934579 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cc5f894d-420e-42e6-8966-12fe740f4b53 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:37.936063 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cc5f894d-420e-42e6-8966-12fe740f4b53 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:37.943670 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cc5f894d-420e-42e6-8966-12fe740f4b53 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:37.944537 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cc5f894d-420e-42e6-8966-12fe740f4b53 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:37.945240 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cc5f894d-420e-42e6-8966-12fe740f4b53 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:37.946446 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cc5f894d-420e-42e6-8966-12fe740f4b53 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:37.947455 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cc5f894d-420e-42e6-8966-12fe740f4b53 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:37.948336 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cc5f894d-420e-42e6-8966-12fe740f4b53 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:38.028239 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-07415cf4-2112-4101-97ca-04945a86ce65 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617/os-volume_attachments/6c2ffc79-79e8-4164-b522-5c3947418079" status: 202 len: 0 microversion: 2.1 time: 0.312578 Oct 17 04:34:38.029040 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 227/448] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Oct 17 04:34:37 2022] DELETE /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617/os-volume_attachments/6c2ffc79-79e8-4164-b522-5c3947418079 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:34:38.112780 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-cc5f894d-420e-42e6-8966-12fe740f4b53 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lazy-loading 'services' on Instance uuid ffc759c8-a208-4df1-bf3e-dd2b89bff369 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:34:38.240580 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cc5f894d-420e-42e6-8966-12fe740f4b53 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369/os-volume_attachments/ea058293-ae48-45f4-b2da-73f9230fdef1" status: 202 len: 0 microversion: 2.1 time: 0.310933 Oct 17 04:34:38.241183 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 222/449] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Oct 17 04:34:37 2022] DELETE /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369/os-volume_attachments/ea058293-ae48-45f4-b2da-73f9230fdef1 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 04:34:38.250156 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-02b45ae9-cf10-422f-977a-bd2ae63e77d5 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:38.252402 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-02b45ae9-cf10-422f-977a-bd2ae63e77d5 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:38.258468 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02b45ae9-cf10-422f-977a-bd2ae63e77d5 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:38.258953 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02b45ae9-cf10-422f-977a-bd2ae63e77d5 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:38.259905 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02b45ae9-cf10-422f-977a-bd2ae63e77d5 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:38.260602 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02b45ae9-cf10-422f-977a-bd2ae63e77d5 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:38.261068 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02b45ae9-cf10-422f-977a-bd2ae63e77d5 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:38.261503 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02b45ae9-cf10-422f-977a-bd2ae63e77d5 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:38.291323 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-02b45ae9-cf10-422f-977a-bd2ae63e77d5 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045160 Oct 17 04:34:38.291694 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 228/450] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:34:38 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:34:38.706831 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ed1ff1cf-67f5-4435-8609-9d3308161329 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:38.707533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ed1ff1cf-67f5-4435-8609-9d3308161329 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:38.714003 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed1ff1cf-67f5-4435-8609-9d3308161329 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:38.714486 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed1ff1cf-67f5-4435-8609-9d3308161329 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:38.714926 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed1ff1cf-67f5-4435-8609-9d3308161329 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:38.715617 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed1ff1cf-67f5-4435-8609-9d3308161329 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:38.716107 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed1ff1cf-67f5-4435-8609-9d3308161329 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:38.716531 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed1ff1cf-67f5-4435-8609-9d3308161329 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:38.851357 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-ed1ff1cf-67f5-4435-8609-9d3308161329 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:38.860215 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ed1ff1cf-67f5-4435-8609-9d3308161329 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1734 microversion: 2.1 time: 0.157945 Oct 17 04:34:38.860771 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 223/451] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:38 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:39.167238 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-609cd1e3-5d1c-46a0-affc-6149ee79ae4b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:34:39.173570 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-609cd1e3-5d1c-46a0-affc-6149ee79ae4b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:39.174047 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-609cd1e3-5d1c-46a0-affc-6149ee79ae4b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:39.174479 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-609cd1e3-5d1c-46a0-affc-6149ee79ae4b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:39.196973 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-609cd1e3-5d1c-46a0-affc-6149ee79ae4b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Going to try to stop instance {{(pid=119127) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 04:34:39.202608 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:34:39.238490 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-609cd1e3-5d1c-46a0-affc-6149ee79ae4b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "POST /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617/action" status: 202 len: 0 microversion: 2.1 time: 0.075302 Oct 17 04:34:39.239078 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 229/452] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Oct 17 04:34:39 2022] POST /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:34:39.247544 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-74eeaeb3-dc77-41f0-bad8-c9fdccc8be51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:39.248158 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-74eeaeb3-dc77-41f0-bad8-c9fdccc8be51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:39.254437 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74eeaeb3-dc77-41f0-bad8-c9fdccc8be51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:39.254912 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74eeaeb3-dc77-41f0-bad8-c9fdccc8be51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:39.255344 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74eeaeb3-dc77-41f0-bad8-c9fdccc8be51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:39.256072 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74eeaeb3-dc77-41f0-bad8-c9fdccc8be51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:39.256521 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74eeaeb3-dc77-41f0-bad8-c9fdccc8be51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:39.256942 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-74eeaeb3-dc77-41f0-bad8-c9fdccc8be51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:39.304502 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dc461754-b74a-4952-95ac-92b58d5a1d87 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:39.307097 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dc461754-b74a-4952-95ac-92b58d5a1d87 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:39.313397 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc461754-b74a-4952-95ac-92b58d5a1d87 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:39.313966 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc461754-b74a-4952-95ac-92b58d5a1d87 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:39.314492 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc461754-b74a-4952-95ac-92b58d5a1d87 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:39.315254 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc461754-b74a-4952-95ac-92b58d5a1d87 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:39.315887 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc461754-b74a-4952-95ac-92b58d5a1d87 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:39.316651 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc461754-b74a-4952-95ac-92b58d5a1d87 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:39.347900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dc461754-b74a-4952-95ac-92b58d5a1d87 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047683 Oct 17 04:34:39.348397 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 230/453] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:34:39 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:34:39.389320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-74eeaeb3-dc77-41f0-bad8-c9fdccc8be51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:39.398453 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-74eeaeb3-dc77-41f0-bad8-c9fdccc8be51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1723 microversion: 2.1 time: 0.155137 Oct 17 04:34:39.399026 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 224/454] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:39 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:39.883562 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c7ca5ed0-7497-4e6a-bacd-d7fa741d0575 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:39.884161 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c7ca5ed0-7497-4e6a-bacd-d7fa741d0575 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:39.890350 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7ca5ed0-7497-4e6a-bacd-d7fa741d0575 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:39.890847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7ca5ed0-7497-4e6a-bacd-d7fa741d0575 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:39.891778 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7ca5ed0-7497-4e6a-bacd-d7fa741d0575 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:39.891944 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7ca5ed0-7497-4e6a-bacd-d7fa741d0575 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:39.892481 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7ca5ed0-7497-4e6a-bacd-d7fa741d0575 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:39.892811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7ca5ed0-7497-4e6a-bacd-d7fa741d0575 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:40.025478 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c7ca5ed0-7497-4e6a-bacd-d7fa741d0575 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:40.033650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c7ca5ed0-7497-4e6a-bacd-d7fa741d0575 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1714 microversion: 2.1 time: 0.153919 Oct 17 04:34:40.034214 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 231/455] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:39 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:40.145050 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c3ae97fd-d440-4f6e-9248-b4c1069a0506 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:40.145594 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c3ae97fd-d440-4f6e-9248-b4c1069a0506 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:40.152791 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3ae97fd-d440-4f6e-9248-b4c1069a0506 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:40.153317 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3ae97fd-d440-4f6e-9248-b4c1069a0506 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:40.153751 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3ae97fd-d440-4f6e-9248-b4c1069a0506 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:40.154472 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3ae97fd-d440-4f6e-9248-b4c1069a0506 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:40.154921 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3ae97fd-d440-4f6e-9248-b4c1069a0506 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:40.155341 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3ae97fd-d440-4f6e-9248-b4c1069a0506 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:40.235362 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-c3ae97fd-d440-4f6e-9248-b4c1069a0506 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] HTTP exception thrown: Cannot 'detach_volume' instance e5722cf2-3e88-4c8e-a533-e6a228c13a82 while it is in vm_state rescued Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c3ae97fd-d440-4f6e-9248-b4c1069a0506 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Request method failure captured: Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82/os-volume_attachments/a78de63d-2c53-4c69-b85c-68a82e156cb0 HTTP/1.1 Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNqLhF-1OXgaOje4IGVnyezHko7_IZT00YPv9us17-37Q37nMNiHcC_lb8w7eKgJVeRiaXu6_GEjnJM1-HP1OhzVwjZNUQ6agiLoG5Dn6ckIJuDrH2TmKCF4QrHIDvZud13RDaxZYvs15jYkMJ96cW5VSzZewYAyctO5HLh7B5QnLlI Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: 7bd6234b23704bdf809481085ce465eb Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-438926643 Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:34:40.237350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:34:40.238874 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7bd6234b23704bdf809481085ce465eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7bd6234b23704bdf809481085ce465eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7bd6234b23704bdf809481085ce465eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7bd6234b23704bdf809481085ce465eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:34:40.238874 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-ServerRescueNegativeTestJSON-438926643 Oct 17 04:34:40.238874 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: 7bd6234b23704bdf809481085ce465eb Oct 17 04:34:40.238874 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-438926643 Oct 17 04:34:40.238874 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-ServerRescueNegativeTestJSON-438926643-project Oct 17 04:34:40.238874 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:34:40.238874 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:34:40.238874 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: 308c01bc66224188aec055c2397a066b Oct 17 04:34:40.238874 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-ServerRescueNegativeTestJSON-438926643-project Oct 17 04:34:40.238874 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:34:40.238874 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Cannot 'detach_volume' instance e5722cf2-3e88-4c8e-a533-e6a228c13a82 while it is in vm_state rescued Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'server_id': 'e5722cf2-3e88-4c8e-a533-e6a228c13a82', 'id': 'a78de63d-2c53-4c69-b85c-68a82e156cb0'} Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e5722cf2-3e88-4c8e-a533-e6a228c13a82 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:34:40.239635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:34:40.240851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 17 04:34:40.240851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 04:34:40.240851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 04:34:40.240851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 04:34:40.240851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e5722cf2-3e88-4c8e-a533-e6a228c13a82 while it is in vm_state rescued Oct 17 04:34:40.240851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:34:40.240851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:34:40.240851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:34:40.240851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:34:40.240851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:34:40.240851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:34:40.240851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:34:40.240851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:34:40.240851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e5722cf2-3e88-4c8e-a533-e6a228c13a82 while it is in vm_state rescued Oct 17 04:34:40.240851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:34:40.240851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c3ae97fd-d440-4f6e-9248-b4c1069a0506 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Returning 409 to user: Cannot 'detach_volume' instance e5722cf2-3e88-4c8e-a533-e6a228c13a82 while it is in vm_state rescued {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:34:40.241822 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c3ae97fd-d440-4f6e-9248-b4c1069a0506 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82/os-volume_attachments/a78de63d-2c53-4c69-b85c-68a82e156cb0" status: 409 len: 152 microversion: 2.1 time: 0.097792 Oct 17 04:34:40.241822 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 225/456] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Oct 17 04:34:40 2022] DELETE /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82/os-volume_attachments/a78de63d-2c53-4c69-b85c-68a82e156cb0 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 04:34:40.248181 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-037d1e36-3f94-43de-b97f-14b28ac5ccb8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:34:40.248745 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-037d1e36-3f94-43de-b97f-14b28ac5ccb8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:40.255040 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-037d1e36-3f94-43de-b97f-14b28ac5ccb8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:40.255518 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-037d1e36-3f94-43de-b97f-14b28ac5ccb8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:40.255957 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-037d1e36-3f94-43de-b97f-14b28ac5ccb8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:40.256645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-037d1e36-3f94-43de-b97f-14b28ac5ccb8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:40.257134 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-037d1e36-3f94-43de-b97f-14b28ac5ccb8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:40.257541 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-037d1e36-3f94-43de-b97f-14b28ac5ccb8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:40.325905 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-037d1e36-3f94-43de-b97f-14b28ac5ccb8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "POST /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82/action" status: 202 len: 0 microversion: 2.1 time: 0.081960 Oct 17 04:34:40.326534 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 232/457] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Oct 17 04:34:40 2022] POST /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:34:40.335210 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ef51355c-ff2e-452e-8f75-ae017523e0e9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:40.335824 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ef51355c-ff2e-452e-8f75-ae017523e0e9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:40.346292 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef51355c-ff2e-452e-8f75-ae017523e0e9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:40.346793 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef51355c-ff2e-452e-8f75-ae017523e0e9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:40.347246 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef51355c-ff2e-452e-8f75-ae017523e0e9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:40.347952 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef51355c-ff2e-452e-8f75-ae017523e0e9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:40.348435 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef51355c-ff2e-452e-8f75-ae017523e0e9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:40.348861 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef51355c-ff2e-452e-8f75-ae017523e0e9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:40.365017 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-46a64def-82cc-4983-b419-2d90966aff57 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:40.368497 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-46a64def-82cc-4983-b419-2d90966aff57 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:40.375632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46a64def-82cc-4983-b419-2d90966aff57 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:40.376117 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46a64def-82cc-4983-b419-2d90966aff57 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:40.376546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46a64def-82cc-4983-b419-2d90966aff57 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:40.377279 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46a64def-82cc-4983-b419-2d90966aff57 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:40.377915 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46a64def-82cc-4983-b419-2d90966aff57 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:40.378342 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46a64def-82cc-4983-b419-2d90966aff57 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:40.410087 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-46a64def-82cc-4983-b419-2d90966aff57 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051870 Oct 17 04:34:40.410571 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 233/458] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:34:40 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:34:40.422638 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-75c680bc-59dd-4359-b7f6-e2f8200b9f51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:40.423279 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-75c680bc-59dd-4359-b7f6-e2f8200b9f51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:40.429186 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75c680bc-59dd-4359-b7f6-e2f8200b9f51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:40.429666 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75c680bc-59dd-4359-b7f6-e2f8200b9f51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:40.430094 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75c680bc-59dd-4359-b7f6-e2f8200b9f51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:40.430789 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75c680bc-59dd-4359-b7f6-e2f8200b9f51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:40.431236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75c680bc-59dd-4359-b7f6-e2f8200b9f51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:40.431651 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75c680bc-59dd-4359-b7f6-e2f8200b9f51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:40.520422 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-ef51355c-ff2e-452e-8f75-ae017523e0e9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:40.530381 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ef51355c-ff2e-452e-8f75-ae017523e0e9 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1722 microversion: 2.1 time: 0.198949 Oct 17 04:34:40.531370 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 226/459] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:40 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:40.592142 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-75c680bc-59dd-4359-b7f6-e2f8200b9f51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:40.599994 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-75c680bc-59dd-4359-b7f6-e2f8200b9f51 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1677 microversion: 2.1 time: 0.181219 Oct 17 04:34:40.606838 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 234/460] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:40 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:34:41.423071 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9d8feeec-5392-4b90-af15-c9e7ff3ba3e8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:41.425371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9d8feeec-5392-4b90-af15-c9e7ff3ba3e8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:41.431668 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d8feeec-5392-4b90-af15-c9e7ff3ba3e8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:41.432133 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d8feeec-5392-4b90-af15-c9e7ff3ba3e8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:41.432600 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d8feeec-5392-4b90-af15-c9e7ff3ba3e8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:41.433304 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d8feeec-5392-4b90-af15-c9e7ff3ba3e8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:41.433750 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d8feeec-5392-4b90-af15-c9e7ff3ba3e8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:41.434166 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d8feeec-5392-4b90-af15-c9e7ff3ba3e8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:41.462525 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9d8feeec-5392-4b90-af15-c9e7ff3ba3e8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043370 Oct 17 04:34:41.463073 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 227/461] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:34:41 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 04:34:41.524313 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-826bcef8-2ac2-41d9-945e-12016b412305 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:41.524817 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-826bcef8-2ac2-41d9-945e-12016b412305 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:41.531789 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-826bcef8-2ac2-41d9-945e-12016b412305 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:41.532260 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-826bcef8-2ac2-41d9-945e-12016b412305 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:41.532690 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-826bcef8-2ac2-41d9-945e-12016b412305 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:41.533397 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-826bcef8-2ac2-41d9-945e-12016b412305 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:41.533843 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-826bcef8-2ac2-41d9-945e-12016b412305 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:41.534258 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-826bcef8-2ac2-41d9-945e-12016b412305 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:41.554035 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-86e51f47-cc04-483b-b67b-377d2e7cfc44 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:41.554759 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-86e51f47-cc04-483b-b67b-377d2e7cfc44 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:41.559535 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-826bcef8-2ac2-41d9-945e-12016b412305 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:34:41.561418 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-86e51f47-cc04-483b-b67b-377d2e7cfc44 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:41.561913 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-86e51f47-cc04-483b-b67b-377d2e7cfc44 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:41.562362 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-86e51f47-cc04-483b-b67b-377d2e7cfc44 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:41.563061 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-86e51f47-cc04-483b-b67b-377d2e7cfc44 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:41.563544 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-86e51f47-cc04-483b-b67b-377d2e7cfc44 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:41.563972 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-86e51f47-cc04-483b-b67b-377d2e7cfc44 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:41.637131 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-826bcef8-2ac2-41d9-945e-12016b412305 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 204 len: 0 microversion: 2.1 time: 0.116260 Oct 17 04:34:41.637730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 235/462] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:34:41 2022] DELETE /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:34:41.643284 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dc52b3ce-bfa6-4123-add7-8c8a3e640f35 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:41.643989 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dc52b3ce-bfa6-4123-add7-8c8a3e640f35 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:41.649666 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc52b3ce-bfa6-4123-add7-8c8a3e640f35 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:41.650241 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc52b3ce-bfa6-4123-add7-8c8a3e640f35 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:41.650565 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc52b3ce-bfa6-4123-add7-8c8a3e640f35 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:41.651822 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc52b3ce-bfa6-4123-add7-8c8a3e640f35 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:41.652279 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc52b3ce-bfa6-4123-add7-8c8a3e640f35 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:41.652701 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc52b3ce-bfa6-4123-add7-8c8a3e640f35 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:41.710372 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-86e51f47-cc04-483b-b67b-377d2e7cfc44 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:41.719817 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-86e51f47-cc04-483b-b67b-377d2e7cfc44 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1722 microversion: 2.1 time: 0.169623 Oct 17 04:34:41.720477 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 228/463] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:41 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:34:41.724871 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cf4d8074-c17c-45d5-b292-bad03957ec07 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:41.725497 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cf4d8074-c17c-45d5-b292-bad03957ec07 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:41.731730 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf4d8074-c17c-45d5-b292-bad03957ec07 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:41.732209 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf4d8074-c17c-45d5-b292-bad03957ec07 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:41.732639 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf4d8074-c17c-45d5-b292-bad03957ec07 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:41.733409 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf4d8074-c17c-45d5-b292-bad03957ec07 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:41.733859 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf4d8074-c17c-45d5-b292-bad03957ec07 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:41.734431 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cf4d8074-c17c-45d5-b292-bad03957ec07 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:41.824335 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-dc52b3ce-bfa6-4123-add7-8c8a3e640f35 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:41.832281 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dc52b3ce-bfa6-4123-add7-8c8a3e640f35 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1677 microversion: 2.1 time: 0.193302 Oct 17 04:34:41.832853 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 236/464] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:41 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:41.882374 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-cf4d8074-c17c-45d5-b292-bad03957ec07 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:41.890971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cf4d8074-c17c-45d5-b292-bad03957ec07 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1681 microversion: 2.1 time: 0.169569 Oct 17 04:34:41.891535 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 229/465] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:41 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:42.743876 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-66050c97-f6cd-4c94-ab91-9ab83f8148a6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:42.744516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-66050c97-f6cd-4c94-ab91-9ab83f8148a6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:42.751324 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66050c97-f6cd-4c94-ab91-9ab83f8148a6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:42.751800 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66050c97-f6cd-4c94-ab91-9ab83f8148a6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:42.752233 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66050c97-f6cd-4c94-ab91-9ab83f8148a6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:42.752915 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66050c97-f6cd-4c94-ab91-9ab83f8148a6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:42.753500 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66050c97-f6cd-4c94-ab91-9ab83f8148a6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:42.753924 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66050c97-f6cd-4c94-ab91-9ab83f8148a6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:42.856035 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0b6b7474-d990-4a5b-8cae-a10bf50779b8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:42.856656 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0b6b7474-d990-4a5b-8cae-a10bf50779b8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:42.862998 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b6b7474-d990-4a5b-8cae-a10bf50779b8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:42.863484 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b6b7474-d990-4a5b-8cae-a10bf50779b8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:42.863921 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b6b7474-d990-4a5b-8cae-a10bf50779b8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:42.864614 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b6b7474-d990-4a5b-8cae-a10bf50779b8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:42.865068 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b6b7474-d990-4a5b-8cae-a10bf50779b8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:42.865520 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0b6b7474-d990-4a5b-8cae-a10bf50779b8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:42.881562 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-66050c97-f6cd-4c94-ab91-9ab83f8148a6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:42.890882 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-66050c97-f6cd-4c94-ab91-9ab83f8148a6 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1722 microversion: 2.1 time: 0.150864 Oct 17 04:34:42.891643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 237/466] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:42 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:42.915869 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cfdf91d9-1c2e-46e5-8910-9dcec1d011d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:42.916478 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cfdf91d9-1c2e-46e5-8910-9dcec1d011d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:42.922377 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cfdf91d9-1c2e-46e5-8910-9dcec1d011d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:42.922858 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cfdf91d9-1c2e-46e5-8910-9dcec1d011d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:42.923293 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cfdf91d9-1c2e-46e5-8910-9dcec1d011d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:42.924000 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cfdf91d9-1c2e-46e5-8910-9dcec1d011d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:42.924437 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cfdf91d9-1c2e-46e5-8910-9dcec1d011d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:42.924860 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cfdf91d9-1c2e-46e5-8910-9dcec1d011d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:43.036033 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-0b6b7474-d990-4a5b-8cae-a10bf50779b8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:43.043948 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0b6b7474-d990-4a5b-8cae-a10bf50779b8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1677 microversion: 2.1 time: 0.191769 Oct 17 04:34:43.044513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 230/467] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:42 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:34:43.080401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-cfdf91d9-1c2e-46e5-8910-9dcec1d011d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:43.088005 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cfdf91d9-1c2e-46e5-8910-9dcec1d011d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1681 microversion: 2.1 time: 0.176177 Oct 17 04:34:43.088570 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 238/468] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:42 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:43.915436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0a649ba9-d9dc-4183-973c-168d36a49f1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:43.916044 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0a649ba9-d9dc-4183-973c-168d36a49f1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:43.922923 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a649ba9-d9dc-4183-973c-168d36a49f1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:43.923402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a649ba9-d9dc-4183-973c-168d36a49f1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:43.923830 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a649ba9-d9dc-4183-973c-168d36a49f1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:43.924511 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a649ba9-d9dc-4183-973c-168d36a49f1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:43.924965 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a649ba9-d9dc-4183-973c-168d36a49f1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:43.925417 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a649ba9-d9dc-4183-973c-168d36a49f1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:44.051673 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-0a649ba9-d9dc-4183-973c-168d36a49f1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:44.060602 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0a649ba9-d9dc-4183-973c-168d36a49f1a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1722 microversion: 2.1 time: 0.149027 Oct 17 04:34:44.061201 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 231/469] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:43 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:44.067630 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-77d647b3-f86b-43bc-9d8b-bda9b3b61e5d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:44.068236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-77d647b3-f86b-43bc-9d8b-bda9b3b61e5d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:44.074912 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77d647b3-f86b-43bc-9d8b-bda9b3b61e5d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:44.075407 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77d647b3-f86b-43bc-9d8b-bda9b3b61e5d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:44.075812 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77d647b3-f86b-43bc-9d8b-bda9b3b61e5d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:44.076487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77d647b3-f86b-43bc-9d8b-bda9b3b61e5d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:44.076931 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77d647b3-f86b-43bc-9d8b-bda9b3b61e5d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:44.077621 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77d647b3-f86b-43bc-9d8b-bda9b3b61e5d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:44.111526 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a8145623-611e-4f88-8c1f-8ccbcad2959b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:44.112170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a8145623-611e-4f88-8c1f-8ccbcad2959b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:44.118124 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8145623-611e-4f88-8c1f-8ccbcad2959b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:44.118606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8145623-611e-4f88-8c1f-8ccbcad2959b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:44.119038 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8145623-611e-4f88-8c1f-8ccbcad2959b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:44.119917 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8145623-611e-4f88-8c1f-8ccbcad2959b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:44.121715 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8145623-611e-4f88-8c1f-8ccbcad2959b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:44.122186 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8145623-611e-4f88-8c1f-8ccbcad2959b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:44.261736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-77d647b3-f86b-43bc-9d8b-bda9b3b61e5d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:44.269436 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-77d647b3-f86b-43bc-9d8b-bda9b3b61e5d tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1677 microversion: 2.1 time: 0.205546 Oct 17 04:34:44.270010 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 239/470] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:44 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1677 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:44.286946 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-a8145623-611e-4f88-8c1f-8ccbcad2959b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:44.296462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a8145623-611e-4f88-8c1f-8ccbcad2959b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1681 microversion: 2.1 time: 0.188714 Oct 17 04:34:44.297063 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 232/471] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:44 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:45.083821 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e4a76687-2007-4665-8671-bc52db011dd0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:45.084462 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e4a76687-2007-4665-8671-bc52db011dd0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:45.091460 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e4a76687-2007-4665-8671-bc52db011dd0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:45.091939 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e4a76687-2007-4665-8671-bc52db011dd0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:45.092376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e4a76687-2007-4665-8671-bc52db011dd0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:45.093098 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e4a76687-2007-4665-8671-bc52db011dd0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:45.093551 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e4a76687-2007-4665-8671-bc52db011dd0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:45.093979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e4a76687-2007-4665-8671-bc52db011dd0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:45.231310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e4a76687-2007-4665-8671-bc52db011dd0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:45.239585 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e4a76687-2007-4665-8671-bc52db011dd0 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1728 microversion: 2.1 time: 0.159530 Oct 17 04:34:45.240169 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 240/472] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:45 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:45.263059 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-23880d14-5c60-41dc-a4b7-5afd90652758 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:45.263569 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-23880d14-5c60-41dc-a4b7-5afd90652758 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:45.270126 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23880d14-5c60-41dc-a4b7-5afd90652758 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:45.270604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23880d14-5c60-41dc-a4b7-5afd90652758 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:45.271033 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23880d14-5c60-41dc-a4b7-5afd90652758 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:45.271721 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23880d14-5c60-41dc-a4b7-5afd90652758 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:45.272167 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23880d14-5c60-41dc-a4b7-5afd90652758 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:45.272584 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-23880d14-5c60-41dc-a4b7-5afd90652758 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:45.294838 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-202b01be-1513-4686-82dc-76f8bf034f7b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:45.295723 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-202b01be-1513-4686-82dc-76f8bf034f7b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:45.302318 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-202b01be-1513-4686-82dc-76f8bf034f7b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:45.302811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-202b01be-1513-4686-82dc-76f8bf034f7b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:45.303250 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-202b01be-1513-4686-82dc-76f8bf034f7b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:45.303987 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-202b01be-1513-4686-82dc-76f8bf034f7b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:45.304443 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-202b01be-1513-4686-82dc-76f8bf034f7b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:45.304872 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-202b01be-1513-4686-82dc-76f8bf034f7b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:45.367502 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-23880d14-5c60-41dc-a4b7-5afd90652758 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108354 Oct 17 04:34:45.369095 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 233/473] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Oct 17 04:34:45 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:34:45.383788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-beb51eea-3689-484e-9acf-bee45c3620d8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:45.384800 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-beb51eea-3689-484e-9acf-bee45c3620d8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:45.391793 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-beb51eea-3689-484e-9acf-bee45c3620d8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:45.392284 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-beb51eea-3689-484e-9acf-bee45c3620d8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:45.392719 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-beb51eea-3689-484e-9acf-bee45c3620d8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:45.393503 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-beb51eea-3689-484e-9acf-bee45c3620d8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:45.393951 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-beb51eea-3689-484e-9acf-bee45c3620d8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:45.394595 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-beb51eea-3689-484e-9acf-bee45c3620d8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:45.491990 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-202b01be-1513-4686-82dc-76f8bf034f7b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:45.501879 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-202b01be-1513-4686-82dc-76f8bf034f7b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1677 microversion: 2.1 time: 0.212235 Oct 17 04:34:45.514689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 241/474] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:45 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1677 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:45.556280 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-beb51eea-3689-484e-9acf-bee45c3620d8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:45.564326 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-beb51eea-3689-484e-9acf-bee45c3620d8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1681 microversion: 2.1 time: 0.194013 Oct 17 04:34:45.564900 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 234/475] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:45 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1681 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:46.065591 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-bd05e309-9fdf-4faa-a3e4-1f1640689f8d req-0a83359b-6583-4934-874f-9503ee2fbe3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc759c8-a208-4df1-bf3e-dd2b89bff369", "name": "network-vif-deleted", "tag": "96c8acae-b8cc-4eed-af97-bcefcfe399c5"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:34:46.076693 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-bd05e309-9fdf-4faa-a3e4-1f1640689f8d req-0a83359b-6583-4934-874f-9503ee2fbe3c service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:46.077677 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-bd05e309-9fdf-4faa-a3e4-1f1640689f8d req-0a83359b-6583-4934-874f-9503ee2fbe3c service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:46.078249 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-bd05e309-9fdf-4faa-a3e4-1f1640689f8d req-0a83359b-6583-4934-874f-9503ee2fbe3c service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:46.091572 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-bd05e309-9fdf-4faa-a3e4-1f1640689f8d req-0a83359b-6583-4934-874f-9503ee2fbe3c service nova] Creating event network-vif-deleted:96c8acae-b8cc-4eed-af97-bcefcfe399c5 for instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 on hv-cinder-86155 Oct 17 04:34:46.096203 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-bd05e309-9fdf-4faa-a3e4-1f1640689f8d req-0a83359b-6583-4934-874f-9503ee2fbe3c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034660 Oct 17 04:34:46.097395 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 242/476] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:34:46.527362 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e20ba592-4d87-474c-9444-254c8101d642 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:46.528293 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e20ba592-4d87-474c-9444-254c8101d642 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:46.535627 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e20ba592-4d87-474c-9444-254c8101d642 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:46.536352 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e20ba592-4d87-474c-9444-254c8101d642 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:46.537061 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e20ba592-4d87-474c-9444-254c8101d642 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:46.537973 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e20ba592-4d87-474c-9444-254c8101d642 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:46.538663 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e20ba592-4d87-474c-9444-254c8101d642 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:46.539477 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e20ba592-4d87-474c-9444-254c8101d642 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:46.578753 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:34:46.589187 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a3854be-bc28-4c41-8042-ea3cbed8a67e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:46.590347 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1a3854be-bc28-4c41-8042-ea3cbed8a67e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:46.602217 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3854be-bc28-4c41-8042-ea3cbed8a67e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:46.603772 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3854be-bc28-4c41-8042-ea3cbed8a67e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:46.605130 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3854be-bc28-4c41-8042-ea3cbed8a67e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:46.608088 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3854be-bc28-4c41-8042-ea3cbed8a67e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:46.608657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3854be-bc28-4c41-8042-ea3cbed8a67e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:46.613048 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3854be-bc28-4c41-8042-ea3cbed8a67e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:46.631692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:34:46.648677 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3854be-bc28-4c41-8042-ea3cbed8a67e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:46.649528 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3854be-bc28-4c41-8042-ea3cbed8a67e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:46.650195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a3854be-bc28-4c41-8042-ea3cbed8a67e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:46.650965 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-1a3854be-bc28-4c41-8042-ea3cbed8a67e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lazy-loading 'fault' on Instance uuid ffc759c8-a208-4df1-bf3e-dd2b89bff369 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:34:46.729957 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a3854be-bc28-4c41-8042-ea3cbed8a67e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:46.738302 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1a3854be-bc28-4c41-8042-ea3cbed8a67e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 200 len: 1331 microversion: 2.1 time: 0.153910 Oct 17 04:34:46.741513 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 243/477] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:46 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 1331 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:34:46.763552 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e20ba592-4d87-474c-9444-254c8101d642 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:46.771492 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e20ba592-4d87-474c-9444-254c8101d642 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1677 microversion: 2.1 time: 0.248060 Oct 17 04:34:46.772080 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 235/478] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:46 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1677 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:47.764502 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3209392c-ed22-43bb-a476-7795a982defd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:47.765100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3209392c-ed22-43bb-a476-7795a982defd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:47.771440 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3209392c-ed22-43bb-a476-7795a982defd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:47.771915 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3209392c-ed22-43bb-a476-7795a982defd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:47.772344 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3209392c-ed22-43bb-a476-7795a982defd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:47.773026 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3209392c-ed22-43bb-a476-7795a982defd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:47.773494 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3209392c-ed22-43bb-a476-7795a982defd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:47.773906 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3209392c-ed22-43bb-a476-7795a982defd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:47.787610 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-3209392c-ed22-43bb-a476-7795a982defd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] HTTP exception thrown: Instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 could not be found. Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3209392c-ed22-43bb-a476-7795a982defd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Request method failure captured: Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 HTTP/1.1 Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNqRI5416bQSxgt6AXPotC0ZA8EQSE7l65zNcTm_mxUo9wFNmkuLDOKI-_C3Raae9FpamLQxUS44gziCftz35IAzDjSECza3w5spd_jxIdlfyyzXpOJTef9rLRzMW0mp2HVcK15b4ajr4hc5Lz_I9yQNIKfhl18_NwaTHORpu95fjDE Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:34:47.789255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:34:47.790804 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e022e6125e85417881ce226db7a5c764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e022e6125e85417881ce226db7a5c764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:34:47.790804 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:34:47.790804 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:34:47.790804 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:34:47.790804 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:34:47.790804 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:34:47.790804 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:34:47.790804 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 59aa96241a8e4d9db6d255c38f618ca1 Oct 17 04:34:47.790804 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:34:47.790804 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:34:47.790804 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 could not be found. Oct 17 04:34:47.790804 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': 'ffc759c8-a208-4df1-bf3e-dd2b89bff369'} Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 could not be found. Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:34:47.792868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:34:47.794272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:34:47.794272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:34:47.794272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:34:47.794272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:34:47.794272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:34:47.794272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:34:47.794272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:34:47.794272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 could not be found. Oct 17 04:34:47.794272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:34:47.794272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:34:47.794272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:34:47.794272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:34:47.794272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:34:47.794272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:34:47.794272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:34:47.794272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:34:47.794272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 could not be found. Oct 17 04:34:47.794272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:34:47.795462 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3209392c-ed22-43bb-a476-7795a982defd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Returning 404 to user: Instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:34:47.795462 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3209392c-ed22-43bb-a476-7795a982defd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 404 len: 111 microversion: 2.1 time: 0.030716 Oct 17 04:34:47.795462 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 244/479] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:47 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:34:47.796239 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d5337d1b-faf4-42bc-bf09-b7f48b802122 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:47.796883 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d5337d1b-faf4-42bc-bf09-b7f48b802122 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:47.799022 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fe6c6cc3-a009-488a-a218-1b07354053f2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '.version_select at 0x7fc630d15550>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:47.803305 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5337d1b-faf4-42bc-bf09-b7f48b802122 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:47.803789 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5337d1b-faf4-42bc-bf09-b7f48b802122 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:47.804227 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5337d1b-faf4-42bc-bf09-b7f48b802122 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:47.804917 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5337d1b-faf4-42bc-bf09-b7f48b802122 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:47.805435 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5337d1b-faf4-42bc-bf09-b7f48b802122 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:47.805849 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d5337d1b-faf4-42bc-bf09-b7f48b802122 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:47.817724 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fe6c6cc3-a009-488a-a218-1b07354053f2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-200940111" status: 202 len: 0 microversion: 2.1 time: 0.022234 Oct 17 04:34:47.818304 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 245/480] 10.222.0.40 () {58 vars in 1218 bytes} [Mon Oct 17 04:34:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-200940111 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:34:47.942016 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d5337d1b-faf4-42bc-bf09-b7f48b802122 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:47.951086 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d5337d1b-faf4-42bc-bf09-b7f48b802122 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1677 microversion: 2.1 time: 0.158982 Oct 17 04:34:47.951749 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 236/481] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:47 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:48.124315 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-c5a49c30-2ec9-47a8-9632-82be41cebd2a req-cec8b847-002a-4430-8630-a8313555b723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5722cf2-3e88-4c8e-a533-e6a228c13a82", "tag": "d6e73103-0bcc-46c6-a3be-e7d793fb4195"}, {"name": "network-changed", "server_uuid": "e5722cf2-3e88-4c8e-a533-e6a228c13a82", "tag": "d6e73103-0bcc-46c6-a3be-e7d793fb4195"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:34:48.134886 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c5a49c30-2ec9-47a8-9632-82be41cebd2a req-cec8b847-002a-4430-8630-a8313555b723 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:48.136295 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c5a49c30-2ec9-47a8-9632-82be41cebd2a req-cec8b847-002a-4430-8630-a8313555b723 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:48.136883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-c5a49c30-2ec9-47a8-9632-82be41cebd2a req-cec8b847-002a-4430-8630-a8313555b723 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:48.147627 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-c5a49c30-2ec9-47a8-9632-82be41cebd2a req-cec8b847-002a-4430-8630-a8313555b723 service nova] Creating event network-changed:d6e73103-0bcc-46c6-a3be-e7d793fb4195 for instance e5722cf2-3e88-4c8e-a533-e6a228c13a82 on hv-cinder-86155 Oct 17 04:34:48.148145 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-c5a49c30-2ec9-47a8-9632-82be41cebd2a req-cec8b847-002a-4430-8630-a8313555b723 service nova] Creating event network-changed:d6e73103-0bcc-46c6-a3be-e7d793fb4195 for instance e5722cf2-3e88-4c8e-a533-e6a228c13a82 on hv-cinder-86155 Oct 17 04:34:48.154015 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-c5a49c30-2ec9-47a8-9632-82be41cebd2a req-cec8b847-002a-4430-8630-a8313555b723 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034275 Oct 17 04:34:48.154962 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 246/482] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:34:48.477267 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5fc6eca6-320c-4326-8f1e-e5e57dfded71 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Action: 'create', calling method: .version_select at 0x7fc630ff23a0>, body: {"keypair": {"name": "tempest-keypair-551201351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQP+HnLkhUaBRGxRu9ZihBpJNgY3dTUU5O2EGBD2OyY+5PYcuWj0FE1TCNFL4XeP6JK2G/sfS1p+eUXoYEhqIvtWprGfZw65u9w0GCvEi/P2Q1/fMDj8MWr9tEF+TFqUw=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:34:48.492726 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-5fc6eca6-320c-4326-8f1e-e5e57dfded71 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Getting quotas for project e022e6125e85417881ce226db7a5c764. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:34:48.496611 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-5fc6eca6-320c-4326-8f1e-e5e57dfded71 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Getting quotas for user 59aa96241a8e4d9db6d255c38f618ca1 and project e022e6125e85417881ce226db7a5c764. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:34:48.520802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5fc6eca6-320c-4326-8f1e-e5e57dfded71 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047439 Oct 17 04:34:48.521457 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 237/483] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Oct 17 04:34:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:34:48.978137 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f5621bfd-d058-4761-9324-bf442b299422 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:48.978885 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f5621bfd-d058-4761-9324-bf442b299422 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:48.986032 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5621bfd-d058-4761-9324-bf442b299422 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:48.986764 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5621bfd-d058-4761-9324-bf442b299422 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:48.987201 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5621bfd-d058-4761-9324-bf442b299422 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:48.987905 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5621bfd-d058-4761-9324-bf442b299422 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:48.988351 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5621bfd-d058-4761-9324-bf442b299422 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:48.988779 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5621bfd-d058-4761-9324-bf442b299422 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:49.128334 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f5621bfd-d058-4761-9324-bf442b299422 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:49.137023 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f5621bfd-d058-4761-9324-bf442b299422 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1677 microversion: 2.1 time: 0.163473 Oct 17 04:34:49.138384 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 247/484] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:48 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:50.160158 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-81af650f-dc00-480e-908a-d737f6d9a02b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:50.160670 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-81af650f-dc00-480e-908a-d737f6d9a02b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:50.167236 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81af650f-dc00-480e-908a-d737f6d9a02b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:50.167729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81af650f-dc00-480e-908a-d737f6d9a02b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:50.168156 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81af650f-dc00-480e-908a-d737f6d9a02b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:50.168851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81af650f-dc00-480e-908a-d737f6d9a02b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:50.169330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81af650f-dc00-480e-908a-d737f6d9a02b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:50.169756 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-81af650f-dc00-480e-908a-d737f6d9a02b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:50.303586 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-81af650f-dc00-480e-908a-d737f6d9a02b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:50.306423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-85e3652b-b85a-4d5a-be54-363c9002aa78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1319256595", "imageRef": "bf655d8c-fb2f-42ef-a7a7-0386f57b58cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60b2c529-82f9-47ea-9951-24ba7b38ebc9"}], "security_groups": [{"name": "tempest-securitygroup--973753090"}], "key_name": "tempest-keypair-551201351", "user_data": "}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:34:50.312409 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-81af650f-dc00-480e-908a-d737f6d9a02b tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1677 microversion: 2.1 time: 0.156147 Oct 17 04:34:50.313103 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 238/485] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:50 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:50.411041 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-85e3652b-b85a-4d5a-be54-363c9002aa78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] validate_networks() for [('60b2c529-82f9-47ea-9951-24ba7b38ebc9', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:34:50.781889 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-85e3652b-b85a-4d5a-be54-363c9002aa78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:34:50.782319 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-85e3652b-b85a-4d5a-be54-363c9002aa78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:34:50.782802 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-85e3652b-b85a-4d5a-be54-363c9002aa78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:34:50.783411 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-85e3652b-b85a-4d5a-be54-363c9002aa78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:34:50.783613 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-85e3652b-b85a-4d5a-be54-363c9002aa78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:34:50.792935 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85e3652b-b85a-4d5a-be54-363c9002aa78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:50.793450 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85e3652b-b85a-4d5a-be54-363c9002aa78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:50.793887 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85e3652b-b85a-4d5a-be54-363c9002aa78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:50.794616 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85e3652b-b85a-4d5a-be54-363c9002aa78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:50.795074 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85e3652b-b85a-4d5a-be54-363c9002aa78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:50.795501 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-85e3652b-b85a-4d5a-be54-363c9002aa78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:50.812167 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-85e3652b-b85a-4d5a-be54-363c9002aa78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Getting quotas for project e022e6125e85417881ce226db7a5c764. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:34:50.816052 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-85e3652b-b85a-4d5a-be54-363c9002aa78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Getting quotas for user 59aa96241a8e4d9db6d255c38f618ca1 and project e022e6125e85417881ce226db7a5c764. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:34:50.827905 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-85e3652b-b85a-4d5a-be54-363c9002aa78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:34:50.830244 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-85e3652b-b85a-4d5a-be54-363c9002aa78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf655d8c-fb2f-42ef-a7a7-0386f57b58cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:34:50.875397 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-85e3652b-b85a-4d5a-be54-363c9002aa78 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.573305 Oct 17 04:34:50.876051 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 248/486] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:34:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 04:34:50.887647 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-46a20692-ed8e-4b4d-b65b-a9882ce925e1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:50.888263 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-46a20692-ed8e-4b4d-b65b-a9882ce925e1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:50.941037 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-46a20692-ed8e-4b4d-b65b-a9882ce925e1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:50.947700 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-46a20692-ed8e-4b4d-b65b-a9882ce925e1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928" status: 200 len: 1241 microversion: 2.1 time: 0.064527 Oct 17 04:34:50.949557 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 239/487] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:50 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:51.336691 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-602bdc17-e397-4108-873a-6364475093a8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:51.337525 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-602bdc17-e397-4108-873a-6364475093a8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:51.344976 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-602bdc17-e397-4108-873a-6364475093a8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:51.345997 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-602bdc17-e397-4108-873a-6364475093a8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:51.346891 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-602bdc17-e397-4108-873a-6364475093a8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:51.348274 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-602bdc17-e397-4108-873a-6364475093a8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:51.349405 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-602bdc17-e397-4108-873a-6364475093a8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:51.350388 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-602bdc17-e397-4108-873a-6364475093a8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:51.484722 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-602bdc17-e397-4108-873a-6364475093a8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:51.492437 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-602bdc17-e397-4108-873a-6364475093a8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1654 microversion: 2.1 time: 0.160219 Oct 17 04:34:51.493008 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 249/488] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:51 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1654 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:51.516379 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ef568808-57c9-4061-9f71-77a8b22a5c85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:34:51.523144 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef568808-57c9-4061-9f71-77a8b22a5c85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:51.523621 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef568808-57c9-4061-9f71-77a8b22a5c85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:51.524080 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef568808-57c9-4061-9f71-77a8b22a5c85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:51.586169 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ef568808-57c9-4061-9f71-77a8b22a5c85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Going to try to start instance {{(pid=119128) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 04:34:51.628922 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ef568808-57c9-4061-9f71-77a8b22a5c85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "POST /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617/action" status: 202 len: 0 microversion: 2.1 time: 0.116265 Oct 17 04:34:51.629650 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 240/489] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Oct 17 04:34:51 2022] POST /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:34:51.638684 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9398e5f3-642f-4241-ba26-001c3381e6c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:51.639391 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9398e5f3-642f-4241-ba26-001c3381e6c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:51.645411 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9398e5f3-642f-4241-ba26-001c3381e6c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:51.645898 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9398e5f3-642f-4241-ba26-001c3381e6c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:51.646336 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9398e5f3-642f-4241-ba26-001c3381e6c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:51.647032 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9398e5f3-642f-4241-ba26-001c3381e6c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:51.647485 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9398e5f3-642f-4241-ba26-001c3381e6c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:51.648091 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9398e5f3-642f-4241-ba26-001c3381e6c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:51.790512 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-9398e5f3-642f-4241-ba26-001c3381e6c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:51.798714 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9398e5f3-642f-4241-ba26-001c3381e6c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1663 microversion: 2.1 time: 0.164527 Oct 17 04:34:51.799282 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 250/490] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:51 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:51.972380 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-edfe64c4-0d94-484e-9957-a6e38ffae869 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:51.973131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-edfe64c4-0d94-484e-9957-a6e38ffae869 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:51.979876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edfe64c4-0d94-484e-9957-a6e38ffae869 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:51.980743 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edfe64c4-0d94-484e-9957-a6e38ffae869 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:51.981204 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edfe64c4-0d94-484e-9957-a6e38ffae869 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:51.981886 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edfe64c4-0d94-484e-9957-a6e38ffae869 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:51.982330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edfe64c4-0d94-484e-9957-a6e38ffae869 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:51.982841 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-edfe64c4-0d94-484e-9957-a6e38ffae869 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:52.052200 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-edfe64c4-0d94-484e-9957-a6e38ffae869 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:52.061039 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-edfe64c4-0d94-484e-9957-a6e38ffae869 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928" status: 200 len: 1293 microversion: 2.1 time: 0.092866 Oct 17 04:34:52.061900 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 241/491] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:51 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:34:52.822202 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c17d955e-a7eb-404b-8764-4331d024c95c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:52.822839 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c17d955e-a7eb-404b-8764-4331d024c95c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:52.829490 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c17d955e-a7eb-404b-8764-4331d024c95c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:52.829974 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c17d955e-a7eb-404b-8764-4331d024c95c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:52.830409 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c17d955e-a7eb-404b-8764-4331d024c95c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:52.831104 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c17d955e-a7eb-404b-8764-4331d024c95c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:52.831557 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c17d955e-a7eb-404b-8764-4331d024c95c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:52.831978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c17d955e-a7eb-404b-8764-4331d024c95c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:52.966883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c17d955e-a7eb-404b-8764-4331d024c95c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:52.974899 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c17d955e-a7eb-404b-8764-4331d024c95c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1663 microversion: 2.1 time: 0.156564 Oct 17 04:34:52.975834 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 251/492] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:52 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:53.084103 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7f865aaa-8d16-42b4-bee8-a8a73ff5357f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:53.084731 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7f865aaa-8d16-42b4-bee8-a8a73ff5357f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:53.092064 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f865aaa-8d16-42b4-bee8-a8a73ff5357f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:53.092555 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f865aaa-8d16-42b4-bee8-a8a73ff5357f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:53.092988 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f865aaa-8d16-42b4-bee8-a8a73ff5357f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:53.093715 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f865aaa-8d16-42b4-bee8-a8a73ff5357f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:53.094167 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f865aaa-8d16-42b4-bee8-a8a73ff5357f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:53.094799 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7f865aaa-8d16-42b4-bee8-a8a73ff5357f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:53.160095 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-7f865aaa-8d16-42b4-bee8-a8a73ff5357f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:53.168164 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7f865aaa-8d16-42b4-bee8-a8a73ff5357f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928" status: 200 len: 1299 microversion: 2.1 time: 0.088046 Oct 17 04:34:53.169065 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 242/493] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:53 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:53.998668 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-173c0d98-0fd3-41f1-99e1-1ffc9ff9680c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:53.999312 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-173c0d98-0fd3-41f1-99e1-1ffc9ff9680c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:54.005754 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-173c0d98-0fd3-41f1-99e1-1ffc9ff9680c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:54.006277 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-173c0d98-0fd3-41f1-99e1-1ffc9ff9680c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:54.006671 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-173c0d98-0fd3-41f1-99e1-1ffc9ff9680c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:54.007553 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-173c0d98-0fd3-41f1-99e1-1ffc9ff9680c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:54.008195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-173c0d98-0fd3-41f1-99e1-1ffc9ff9680c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:54.008604 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-173c0d98-0fd3-41f1-99e1-1ffc9ff9680c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:54.139794 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-173c0d98-0fd3-41f1-99e1-1ffc9ff9680c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:54.147578 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-173c0d98-0fd3-41f1-99e1-1ffc9ff9680c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1667 microversion: 2.1 time: 0.152908 Oct 17 04:34:54.148142 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 252/494] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:53 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:54.191122 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7ae5afc7-5286-4b62-9d9f-5877562f6aa9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:54.191744 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7ae5afc7-5286-4b62-9d9f-5877562f6aa9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:54.198509 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ae5afc7-5286-4b62-9d9f-5877562f6aa9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:54.198995 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ae5afc7-5286-4b62-9d9f-5877562f6aa9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:54.199430 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ae5afc7-5286-4b62-9d9f-5877562f6aa9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:54.200129 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ae5afc7-5286-4b62-9d9f-5877562f6aa9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:54.200580 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ae5afc7-5286-4b62-9d9f-5877562f6aa9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:54.201003 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ae5afc7-5286-4b62-9d9f-5877562f6aa9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:54.332184 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-7ae5afc7-5286-4b62-9d9f-5877562f6aa9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:54.340695 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7ae5afc7-5286-4b62-9d9f-5877562f6aa9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928" status: 200 len: 1366 microversion: 2.1 time: 0.153382 Oct 17 04:34:54.341542 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 243/495] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:54 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:54.561799 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-040e3246-c218-4797-9b99-f0943356e951 req-5f6d657d-5ebd-4ee1-80f9-292e5593bf18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00d500c7-5fa9-4811-8064-25f3c15d0928", "tag": "b5d22a9b-0e70-4aa1-8839-2f3f94ffa514"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:34:54.572254 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-040e3246-c218-4797-9b99-f0943356e951 req-5f6d657d-5ebd-4ee1-80f9-292e5593bf18 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:54.573057 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-040e3246-c218-4797-9b99-f0943356e951 req-5f6d657d-5ebd-4ee1-80f9-292e5593bf18 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:54.573755 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-040e3246-c218-4797-9b99-f0943356e951 req-5f6d657d-5ebd-4ee1-80f9-292e5593bf18 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:54.586162 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-040e3246-c218-4797-9b99-f0943356e951 req-5f6d657d-5ebd-4ee1-80f9-292e5593bf18 service nova] Creating event network-changed:b5d22a9b-0e70-4aa1-8839-2f3f94ffa514 for instance 00d500c7-5fa9-4811-8064-25f3c15d0928 on hv-cinder-86155 Oct 17 04:34:54.591495 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-040e3246-c218-4797-9b99-f0943356e951 req-5f6d657d-5ebd-4ee1-80f9-292e5593bf18 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034658 Oct 17 04:34:54.592095 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 253/496] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:34:55.366296 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f4067b5c-ed6f-47a3-bd60-0ce796635c5e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:55.367000 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f4067b5c-ed6f-47a3-bd60-0ce796635c5e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:55.374615 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4067b5c-ed6f-47a3-bd60-0ce796635c5e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:55.375097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4067b5c-ed6f-47a3-bd60-0ce796635c5e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:55.375534 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4067b5c-ed6f-47a3-bd60-0ce796635c5e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:55.376232 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4067b5c-ed6f-47a3-bd60-0ce796635c5e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:55.376682 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4067b5c-ed6f-47a3-bd60-0ce796635c5e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:55.377246 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f4067b5c-ed6f-47a3-bd60-0ce796635c5e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:55.506525 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f4067b5c-ed6f-47a3-bd60-0ce796635c5e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:55.514685 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f4067b5c-ed6f-47a3-bd60-0ce796635c5e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928" status: 200 len: 1366 microversion: 2.1 time: 0.154960 Oct 17 04:34:55.515283 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 244/497] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:55 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:56.539028 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2f718292-aeec-4ee2-aea4-421bee009b56 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:56.539640 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2f718292-aeec-4ee2-aea4-421bee009b56 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:56.546613 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f718292-aeec-4ee2-aea4-421bee009b56 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:56.547092 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f718292-aeec-4ee2-aea4-421bee009b56 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:56.547525 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f718292-aeec-4ee2-aea4-421bee009b56 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:56.548212 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f718292-aeec-4ee2-aea4-421bee009b56 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:56.548665 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f718292-aeec-4ee2-aea4-421bee009b56 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:56.549101 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f718292-aeec-4ee2-aea4-421bee009b56 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:56.675847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-2f718292-aeec-4ee2-aea4-421bee009b56 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:56.683667 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2f718292-aeec-4ee2-aea4-421bee009b56 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928" status: 200 len: 1366 microversion: 2.1 time: 0.149582 Oct 17 04:34:56.684246 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 254/498] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:56 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:57.707027 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6fb7a2c1-08d4-40c5-bd00-fb6fbb6488e3 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:57.707636 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6fb7a2c1-08d4-40c5-bd00-fb6fbb6488e3 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:57.715047 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fb7a2c1-08d4-40c5-bd00-fb6fbb6488e3 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:57.715528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fb7a2c1-08d4-40c5-bd00-fb6fbb6488e3 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:57.715962 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fb7a2c1-08d4-40c5-bd00-fb6fbb6488e3 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:57.716644 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fb7a2c1-08d4-40c5-bd00-fb6fbb6488e3 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:57.717118 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fb7a2c1-08d4-40c5-bd00-fb6fbb6488e3 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:57.717574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6fb7a2c1-08d4-40c5-bd00-fb6fbb6488e3 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:57.846875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-6fb7a2c1-08d4-40c5-bd00-fb6fbb6488e3 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:57.855022 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6fb7a2c1-08d4-40c5-bd00-fb6fbb6488e3 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928" status: 200 len: 1366 microversion: 2.1 time: 0.151904 Oct 17 04:34:57.855582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 245/499] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:57 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:34:58.877348 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9b2b70f8-2642-4a49-9e9c-193124ffd5f7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:34:58.878020 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9b2b70f8-2642-4a49-9e9c-193124ffd5f7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:34:58.880411 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:34:58.885711 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b2b70f8-2642-4a49-9e9c-193124ffd5f7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:58.886366 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b2b70f8-2642-4a49-9e9c-193124ffd5f7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:58.886803 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b2b70f8-2642-4a49-9e9c-193124ffd5f7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:58.887492 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b2b70f8-2642-4a49-9e9c-193124ffd5f7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:34:58.887944 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b2b70f8-2642-4a49-9e9c-193124ffd5f7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:34:58.888367 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9b2b70f8-2642-4a49-9e9c-193124ffd5f7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:34:59.018627 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-9b2b70f8-2642-4a49-9e9c-193124ffd5f7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:34:59.026784 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9b2b70f8-2642-4a49-9e9c-193124ffd5f7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928" status: 200 len: 1366 microversion: 2.1 time: 0.153373 Oct 17 04:34:59.027353 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 255/500] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:34:58 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:00.049608 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5f75f1d3-5a6e-4d78-8d1b-586fd5e5908b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:00.050224 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5f75f1d3-5a6e-4d78-8d1b-586fd5e5908b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:00.056606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f75f1d3-5a6e-4d78-8d1b-586fd5e5908b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:00.057602 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f75f1d3-5a6e-4d78-8d1b-586fd5e5908b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:00.058193 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f75f1d3-5a6e-4d78-8d1b-586fd5e5908b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:00.058878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f75f1d3-5a6e-4d78-8d1b-586fd5e5908b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:00.059327 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f75f1d3-5a6e-4d78-8d1b-586fd5e5908b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:00.059745 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5f75f1d3-5a6e-4d78-8d1b-586fd5e5908b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:00.189693 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-5f75f1d3-5a6e-4d78-8d1b-586fd5e5908b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:00.197162 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5f75f1d3-5a6e-4d78-8d1b-586fd5e5908b tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928" status: 200 len: 1366 microversion: 2.1 time: 0.151383 Oct 17 04:35:00.198793 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 246/501] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:00 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:00.415145 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-e949442a-a474-4e48-8aa8-31deb87d7ec7 req-729926be-326c-414a-94b1-2ff83ea69d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d500c7-5fa9-4811-8064-25f3c15d0928", "name": "network-vif-plugged", "status": "completed", "tag": "b5d22a9b-0e70-4aa1-8839-2f3f94ffa514"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:35:00.428037 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e949442a-a474-4e48-8aa8-31deb87d7ec7 req-729926be-326c-414a-94b1-2ff83ea69d46 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:00.428662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e949442a-a474-4e48-8aa8-31deb87d7ec7 req-729926be-326c-414a-94b1-2ff83ea69d46 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:00.429292 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-e949442a-a474-4e48-8aa8-31deb87d7ec7 req-729926be-326c-414a-94b1-2ff83ea69d46 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:00.441754 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-e949442a-a474-4e48-8aa8-31deb87d7ec7 req-729926be-326c-414a-94b1-2ff83ea69d46 service nova] Creating event network-vif-plugged:b5d22a9b-0e70-4aa1-8839-2f3f94ffa514 for instance 00d500c7-5fa9-4811-8064-25f3c15d0928 on hv-cinder-86155 Oct 17 04:35:00.446756 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-e949442a-a474-4e48-8aa8-31deb87d7ec7 req-729926be-326c-414a-94b1-2ff83ea69d46 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035598 Oct 17 04:35:00.447345 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 256/502] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:35:01.220340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8f9a17c2-d6e9-40f1-ad3a-84b6f7fb0cf8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:01.220955 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8f9a17c2-d6e9-40f1-ad3a-84b6f7fb0cf8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:01.222979 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:35:01.228549 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f9a17c2-d6e9-40f1-ad3a-84b6f7fb0cf8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:01.229270 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f9a17c2-d6e9-40f1-ad3a-84b6f7fb0cf8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:01.229718 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f9a17c2-d6e9-40f1-ad3a-84b6f7fb0cf8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:01.230406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f9a17c2-d6e9-40f1-ad3a-84b6f7fb0cf8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:01.230859 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f9a17c2-d6e9-40f1-ad3a-84b6f7fb0cf8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:01.231283 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8f9a17c2-d6e9-40f1-ad3a-84b6f7fb0cf8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:01.359903 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-8f9a17c2-d6e9-40f1-ad3a-84b6f7fb0cf8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:01.367463 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8f9a17c2-d6e9-40f1-ad3a-84b6f7fb0cf8 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928" status: 200 len: 1366 microversion: 2.1 time: 0.150977 Oct 17 04:35:01.368022 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 247/503] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:01 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:02.392216 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b704c959-9f7b-42cc-aa12-bbc075ba8ebb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:02.392829 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b704c959-9f7b-42cc-aa12-bbc075ba8ebb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:02.394737 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:35:02.395498 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:35:02.401932 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b704c959-9f7b-42cc-aa12-bbc075ba8ebb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:02.402405 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b704c959-9f7b-42cc-aa12-bbc075ba8ebb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:02.402858 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b704c959-9f7b-42cc-aa12-bbc075ba8ebb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:02.403538 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b704c959-9f7b-42cc-aa12-bbc075ba8ebb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:02.403986 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b704c959-9f7b-42cc-aa12-bbc075ba8ebb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:02.404406 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b704c959-9f7b-42cc-aa12-bbc075ba8ebb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:02.536646 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b704c959-9f7b-42cc-aa12-bbc075ba8ebb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:02.544544 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b704c959-9f7b-42cc-aa12-bbc075ba8ebb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928" status: 200 len: 1366 microversion: 2.1 time: 0.156554 Oct 17 04:35:02.545137 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 257/504] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:02 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:03.567372 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-89a931e6-0c6c-4a6e-9161-4efc41e2d58d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:03.568019 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-89a931e6-0c6c-4a6e-9161-4efc41e2d58d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:03.570366 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:35:03.576523 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89a931e6-0c6c-4a6e-9161-4efc41e2d58d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:03.577063 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89a931e6-0c6c-4a6e-9161-4efc41e2d58d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:03.577772 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89a931e6-0c6c-4a6e-9161-4efc41e2d58d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:03.578567 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89a931e6-0c6c-4a6e-9161-4efc41e2d58d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:03.579045 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89a931e6-0c6c-4a6e-9161-4efc41e2d58d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:03.579459 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-89a931e6-0c6c-4a6e-9161-4efc41e2d58d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:03.710481 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-89a931e6-0c6c-4a6e-9161-4efc41e2d58d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:03.718545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-89a931e6-0c6c-4a6e-9161-4efc41e2d58d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928" status: 200 len: 1556 microversion: 2.1 time: 0.154984 Oct 17 04:35:03.719113 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 248/505] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:03 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:03.741220 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-344e53db-1f40-4326-878a-f535d02cef75 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:03.741764 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-344e53db-1f40-4326-878a-f535d02cef75 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:03.749887 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-344e53db-1f40-4326-878a-f535d02cef75 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:03.750513 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-344e53db-1f40-4326-878a-f535d02cef75 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:03.751044 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-344e53db-1f40-4326-878a-f535d02cef75 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:03.751779 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-344e53db-1f40-4326-878a-f535d02cef75 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:03.752567 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-344e53db-1f40-4326-878a-f535d02cef75 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:03.752990 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-344e53db-1f40-4326-878a-f535d02cef75 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:03.833672 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-344e53db-1f40-4326-878a-f535d02cef75 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096296 Oct 17 04:35:03.834263 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 258/506] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Oct 17 04:35:03 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:35:04.446799 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d7706dd4-03e8-4dba-9119-9bfad1089acb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:04.447303 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d7706dd4-03e8-4dba-9119-9bfad1089acb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:04.453532 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7706dd4-03e8-4dba-9119-9bfad1089acb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:04.454048 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7706dd4-03e8-4dba-9119-9bfad1089acb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:04.454452 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7706dd4-03e8-4dba-9119-9bfad1089acb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:04.455144 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7706dd4-03e8-4dba-9119-9bfad1089acb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:04.455598 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7706dd4-03e8-4dba-9119-9bfad1089acb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:04.456145 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d7706dd4-03e8-4dba-9119-9bfad1089acb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:04.485825 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d7706dd4-03e8-4dba-9119-9bfad1089acb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d/os-volume_attachments/5388e111-d7cf-4888-8db4-35cd7c84625f" status: 200 len: 194 microversion: 2.20 time: 0.042996 Oct 17 04:35:04.486423 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 249/507] 10.222.0.40 () {60 vars in 1454 bytes} [Mon Oct 17 04:35:04 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d/os-volume_attachments/5388e111-d7cf-4888-8db4-35cd7c84625f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 04:35:04.562451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3bde95e3-20b6-4120-a55b-a51b32dbffcc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:04.562967 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3bde95e3-20b6-4120-a55b-a51b32dbffcc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:04.569384 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bde95e3-20b6-4120-a55b-a51b32dbffcc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:04.569965 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bde95e3-20b6-4120-a55b-a51b32dbffcc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:04.570468 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bde95e3-20b6-4120-a55b-a51b32dbffcc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:04.571248 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bde95e3-20b6-4120-a55b-a51b32dbffcc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:04.571796 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bde95e3-20b6-4120-a55b-a51b32dbffcc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:04.572289 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bde95e3-20b6-4120-a55b-a51b32dbffcc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:04.664196 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-3bde95e3-20b6-4120-a55b-a51b32dbffcc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lazy-loading 'services' on Instance uuid ee04d43c-6d11-4571-989e-90ee8175e03d {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:35:04.739610 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3bde95e3-20b6-4120-a55b-a51b32dbffcc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d/os-volume_attachments/5388e111-d7cf-4888-8db4-35cd7c84625f" status: 202 len: 0 microversion: 2.20 time: 0.182295 Oct 17 04:35:04.740648 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 259/508] 10.222.0.40 () {60 vars in 1457 bytes} [Mon Oct 17 04:35:04 2022] DELETE /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d/os-volume_attachments/5388e111-d7cf-4888-8db4-35cd7c84625f => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:35:04.749770 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f74ef7e1-0820-4c11-aa52-e2591913e8bb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:04.751950 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f74ef7e1-0820-4c11-aa52-e2591913e8bb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:04.759031 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f74ef7e1-0820-4c11-aa52-e2591913e8bb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:04.759679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f74ef7e1-0820-4c11-aa52-e2591913e8bb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:04.760252 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f74ef7e1-0820-4c11-aa52-e2591913e8bb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:04.761802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f74ef7e1-0820-4c11-aa52-e2591913e8bb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:04.762274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f74ef7e1-0820-4c11-aa52-e2591913e8bb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:04.762707 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f74ef7e1-0820-4c11-aa52-e2591913e8bb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:04.797275 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f74ef7e1-0820-4c11-aa52-e2591913e8bb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052209 Oct 17 04:35:04.797912 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 250/509] 10.222.0.40 () {60 vars in 1343 bytes} [Mon Oct 17 04:35:04 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 04:35:05.003034 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-cb8e8b41-5e4f-4ffe-99fc-26a3fbaf14ec req-2fcba5e8-8861-4fd7-9b26-5e00ab46287d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00d500c7-5fa9-4811-8064-25f3c15d0928", "tag": "b5d22a9b-0e70-4aa1-8839-2f3f94ffa514"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:35:05.014148 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-cb8e8b41-5e4f-4ffe-99fc-26a3fbaf14ec req-2fcba5e8-8861-4fd7-9b26-5e00ab46287d service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:05.014624 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-cb8e8b41-5e4f-4ffe-99fc-26a3fbaf14ec req-2fcba5e8-8861-4fd7-9b26-5e00ab46287d service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:05.015065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-cb8e8b41-5e4f-4ffe-99fc-26a3fbaf14ec req-2fcba5e8-8861-4fd7-9b26-5e00ab46287d service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:05.026357 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-cb8e8b41-5e4f-4ffe-99fc-26a3fbaf14ec req-2fcba5e8-8861-4fd7-9b26-5e00ab46287d service nova] Creating event network-changed:b5d22a9b-0e70-4aa1-8839-2f3f94ffa514 for instance 00d500c7-5fa9-4811-8064-25f3c15d0928 on hv-cinder-86155 Oct 17 04:35:05.031084 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-cb8e8b41-5e4f-4ffe-99fc-26a3fbaf14ec req-2fcba5e8-8861-4fd7-9b26-5e00ab46287d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032191 Oct 17 04:35:05.031672 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 260/510] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:35:05.811666 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c48a5d42-1199-42aa-a594-2f6bdef13301 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:05.814107 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c48a5d42-1199-42aa-a594-2f6bdef13301 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:05.820753 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c48a5d42-1199-42aa-a594-2f6bdef13301 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:05.821474 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c48a5d42-1199-42aa-a594-2f6bdef13301 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:05.822175 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c48a5d42-1199-42aa-a594-2f6bdef13301 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:05.823448 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c48a5d42-1199-42aa-a594-2f6bdef13301 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:05.823901 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c48a5d42-1199-42aa-a594-2f6bdef13301 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:05.824325 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c48a5d42-1199-42aa-a594-2f6bdef13301 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:05.855647 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c48a5d42-1199-42aa-a594-2f6bdef13301 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048055 Oct 17 04:35:05.856525 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 251/511] 10.222.0.40 () {60 vars in 1343 bytes} [Mon Oct 17 04:35:05 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:05.925479 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-69d100cc-694e-42fb-b93a-215802d23aef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:05.926062 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-69d100cc-694e-42fb-b93a-215802d23aef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:05.933010 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-69d100cc-694e-42fb-b93a-215802d23aef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:05.933608 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-69d100cc-694e-42fb-b93a-215802d23aef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:05.934131 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-69d100cc-694e-42fb-b93a-215802d23aef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:05.934977 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-69d100cc-694e-42fb-b93a-215802d23aef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:05.935495 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-69d100cc-694e-42fb-b93a-215802d23aef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:05.935983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-69d100cc-694e-42fb-b93a-215802d23aef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:05.962185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-69d100cc-694e-42fb-b93a-215802d23aef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:35:06.042707 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-69d100cc-694e-42fb-b93a-215802d23aef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 204 len: 0 microversion: 2.20 time: 0.121063 Oct 17 04:35:06.044413 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 261/512] 10.222.0.40 () {60 vars in 1280 bytes} [Mon Oct 17 04:35:05 2022] DELETE /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 04:35:06.053977 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c6585409-49e0-49ba-9b37-7e24d3603ae5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:06.054586 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c6585409-49e0-49ba-9b37-7e24d3603ae5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:06.061515 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6585409-49e0-49ba-9b37-7e24d3603ae5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:06.062000 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6585409-49e0-49ba-9b37-7e24d3603ae5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:06.062431 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6585409-49e0-49ba-9b37-7e24d3603ae5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:06.063124 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6585409-49e0-49ba-9b37-7e24d3603ae5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:06.063569 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6585409-49e0-49ba-9b37-7e24d3603ae5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:06.064181 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6585409-49e0-49ba-9b37-7e24d3603ae5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:06.194515 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-c6585409-49e0-49ba-9b37-7e24d3603ae5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:06.203771 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-c6585409-49e0-49ba-9b37-7e24d3603ae5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:06.205295 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-c6585409-49e0-49ba-9b37-7e24d3603ae5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:06.206514 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c6585409-49e0-49ba-9b37-7e24d3603ae5 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1722 microversion: 2.20 time: 0.157694 Oct 17 04:35:06.207121 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 252/513] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:35:06 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:35:07.232491 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-842f2f9d-7019-410a-9f17-10760eb7e844 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:07.233128 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-842f2f9d-7019-410a-9f17-10760eb7e844 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:07.239483 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-842f2f9d-7019-410a-9f17-10760eb7e844 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:07.239964 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-842f2f9d-7019-410a-9f17-10760eb7e844 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:07.240399 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-842f2f9d-7019-410a-9f17-10760eb7e844 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:07.241101 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-842f2f9d-7019-410a-9f17-10760eb7e844 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:07.241563 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-842f2f9d-7019-410a-9f17-10760eb7e844 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:07.241988 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-842f2f9d-7019-410a-9f17-10760eb7e844 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:07.370306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-842f2f9d-7019-410a-9f17-10760eb7e844 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:07.373820 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:35:07.378980 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-842f2f9d-7019-410a-9f17-10760eb7e844 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:07.380433 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-842f2f9d-7019-410a-9f17-10760eb7e844 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:07.381624 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-842f2f9d-7019-410a-9f17-10760eb7e844 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1722 microversion: 2.20 time: 0.153798 Oct 17 04:35:07.382190 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 262/514] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:35:07 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:35:08.407928 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-64a48fa2-61d3-4b52-a888-d7880c43b24a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:08.408437 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-64a48fa2-61d3-4b52-a888-d7880c43b24a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:08.414884 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64a48fa2-61d3-4b52-a888-d7880c43b24a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:08.415361 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64a48fa2-61d3-4b52-a888-d7880c43b24a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:08.415786 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64a48fa2-61d3-4b52-a888-d7880c43b24a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:08.417110 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64a48fa2-61d3-4b52-a888-d7880c43b24a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:08.417563 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64a48fa2-61d3-4b52-a888-d7880c43b24a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:08.417980 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64a48fa2-61d3-4b52-a888-d7880c43b24a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:08.422012 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:35:08.488395 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-64a48fa2-61d3-4b52-a888-d7880c43b24a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:08.496542 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-64a48fa2-61d3-4b52-a888-d7880c43b24a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:08.498010 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-64a48fa2-61d3-4b52-a888-d7880c43b24a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:08.499176 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-64a48fa2-61d3-4b52-a888-d7880c43b24a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 200 len: 1655 microversion: 2.20 time: 0.095229 Oct 17 04:35:08.499728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 253/515] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:35:08 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 1655 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:35:08.621305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-a6032e62-a1ae-49f3-8fb5-30a5e3912686 req-f885a6eb-f364-434d-af8d-eb8dbb161a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee04d43c-6d11-4571-989e-90ee8175e03d", "name": "network-vif-deleted", "tag": "f63f40c8-b445-4c27-a582-2ac29415fbeb"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:35:08.631811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a6032e62-a1ae-49f3-8fb5-30a5e3912686 req-f885a6eb-f364-434d-af8d-eb8dbb161a12 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:08.632281 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a6032e62-a1ae-49f3-8fb5-30a5e3912686 req-f885a6eb-f364-434d-af8d-eb8dbb161a12 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:08.632710 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a6032e62-a1ae-49f3-8fb5-30a5e3912686 req-f885a6eb-f364-434d-af8d-eb8dbb161a12 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:08.645479 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-a6032e62-a1ae-49f3-8fb5-30a5e3912686 req-f885a6eb-f364-434d-af8d-eb8dbb161a12 service nova] Creating event network-vif-deleted:f63f40c8-b445-4c27-a582-2ac29415fbeb for instance ee04d43c-6d11-4571-989e-90ee8175e03d on hv-cinder-86155 Oct 17 04:35:08.650366 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-a6032e62-a1ae-49f3-8fb5-30a5e3912686 req-f885a6eb-f364-434d-af8d-eb8dbb161a12 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033485 Oct 17 04:35:08.653165 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 263/516] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:35:09.527632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-60a9310d-8410-4e00-bc3e-b31eb0e1c454 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:09.534118 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-60a9310d-8410-4e00-bc3e-b31eb0e1c454 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:09.540896 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60a9310d-8410-4e00-bc3e-b31eb0e1c454 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:09.542059 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60a9310d-8410-4e00-bc3e-b31eb0e1c454 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:09.542430 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60a9310d-8410-4e00-bc3e-b31eb0e1c454 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:09.543177 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60a9310d-8410-4e00-bc3e-b31eb0e1c454 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:09.543706 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60a9310d-8410-4e00-bc3e-b31eb0e1c454 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:09.544119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-60a9310d-8410-4e00-bc3e-b31eb0e1c454 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:09.558445 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-60a9310d-8410-4e00-bc3e-b31eb0e1c454 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] HTTP exception thrown: Instance ee04d43c-6d11-4571-989e-90ee8175e03d could not be found. Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-60a9310d-8410-4e00-bc3e-b31eb0e1c454 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Request method failure captured: Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d HTTP/1.1 Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNqOaNkLUlIe9JkghowX7Loqffk0uxjchW8tNDWNyFdJmXd3HGh7rXAcJtkLn9FF7SIVSDYM5fbILB80s58J2Q8MZXRoIORMxdNY-csEJlqw_o9nEz8wr_KTz2Wpy5BA0EubJr2HuLYBXiLJplJWKFvxE1H0eUuu1cVrLOw3nknNOzA Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: 0761fde06e5240adb0d7f1a7d5724d37 Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-737796925 Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:35:09.560097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:35:09.561788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:35:09.561788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeShelveTestJSON-737796925 Oct 17 04:35:09.561788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: 0761fde06e5240adb0d7f1a7d5724d37 Oct 17 04:35:09.561788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-737796925 Oct 17 04:35:09.561788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-AttachVolumeShelveTestJSON-737796925-project Oct 17 04:35:09.561788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:35:09.561788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:35:09.561788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: c7ea83c1a5d34727943721cd91e7268d Oct 17 04:35:09.561788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeShelveTestJSON-737796925-project Oct 17 04:35:09.561788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:35:09.561788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance ee04d43c-6d11-4571-989e-90ee8175e03d could not be found. Oct 17 04:35:09.561788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': 'ee04d43c-6d11-4571-989e-90ee8175e03d'} Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee04d43c-6d11-4571-989e-90ee8175e03d could not be found. Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:35:09.566101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:35:09.567365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:35:09.567365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:35:09.567365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:35:09.567365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:35:09.567365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:35:09.567365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:35:09.567365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:35:09.567365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee04d43c-6d11-4571-989e-90ee8175e03d could not be found. Oct 17 04:35:09.567365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:35:09.567365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:35:09.567365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:35:09.567365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:35:09.567365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:35:09.567365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:35:09.567365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:35:09.567365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:35:09.567365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee04d43c-6d11-4571-989e-90ee8175e03d could not be found. Oct 17 04:35:09.567365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:35:09.568558 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-60a9310d-8410-4e00-bc3e-b31eb0e1c454 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Returning 404 to user: Instance ee04d43c-6d11-4571-989e-90ee8175e03d could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:35:09.568558 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-60a9310d-8410-4e00-bc3e-b31eb0e1c454 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 404 len: 111 microversion: 2.20 time: 0.041503 Oct 17 04:35:09.568558 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 254/517] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:35:09 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 04:35:09.570987 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d7d7bab1-acc1-449d-850b-f6912aa6f22c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '.version_select at 0x7fc630ccda60>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:09.590070 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d7d7bab1-acc1-449d-850b-f6912aa6f22c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1214594123" status: 204 len: 0 microversion: 2.20 time: 0.023162 Oct 17 04:35:09.590657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 264/518] 10.222.0.40 () {60 vars in 1262 bytes} [Mon Oct 17 04:35:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1214594123 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 17 04:35:10.207037 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7457f7cf-c932-4c6e-920a-499d20f9f8ac tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Action: 'create', calling method: .version_select at 0x7fc630f21280>, body: {"keypair": {"name": "tempest-keypair-540557241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOumFUQpbzEHWBCqxZ5Yj+2ms6mYN72u5mZLAxwuLfxR4/HPMY31g8FAsVd+t9+K7toKwnq8BPVqHtPyHTpXnRz+AGPNVTBBJ3j7N8ZO0t5cxwSk7xrb6ndBaK6jPMaBnA=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:35:10.222677 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-7457f7cf-c932-4c6e-920a-499d20f9f8ac tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Getting quotas for project 0761fde06e5240adb0d7f1a7d5724d37. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:35:10.226461 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-7457f7cf-c932-4c6e-920a-499d20f9f8ac tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Getting quotas for user c7ea83c1a5d34727943721cd91e7268d and project 0761fde06e5240adb0d7f1a7d5724d37. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:35:10.251188 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7457f7cf-c932-4c6e-920a-499d20f9f8ac tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.048075 Oct 17 04:35:10.251769 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 255/519] 10.222.0.40 () {62 vars in 1200 bytes} [Mon Oct 17 04:35:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 17 04:35:12.152641 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-66f09a15-f32f-4aee-9df0-80b94a484cb0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-904133961", "imageRef": "bf655d8c-fb2f-42ef-a7a7-0386f57b58cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "596ebb0d-79d0-45f5-9e52-b2ce25b00863"}], "security_groups": [{"name": "tempest-securitygroup--770384293"}], "key_name": "tempest-keypair-540557241", "user_data": "}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:35:12.256736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-66f09a15-f32f-4aee-9df0-80b94a484cb0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] validate_networks() for [('596ebb0d-79d0-45f5-9e52-b2ce25b00863', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:35:12.618523 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-66f09a15-f32f-4aee-9df0-80b94a484cb0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:35:12.618974 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-66f09a15-f32f-4aee-9df0-80b94a484cb0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:35:12.620046 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-66f09a15-f32f-4aee-9df0-80b94a484cb0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:35:12.620477 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-66f09a15-f32f-4aee-9df0-80b94a484cb0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:35:12.620900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-66f09a15-f32f-4aee-9df0-80b94a484cb0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:35:12.629569 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66f09a15-f32f-4aee-9df0-80b94a484cb0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:12.630040 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66f09a15-f32f-4aee-9df0-80b94a484cb0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:12.630463 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66f09a15-f32f-4aee-9df0-80b94a484cb0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:12.631175 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66f09a15-f32f-4aee-9df0-80b94a484cb0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:12.631619 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66f09a15-f32f-4aee-9df0-80b94a484cb0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:12.632037 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-66f09a15-f32f-4aee-9df0-80b94a484cb0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:12.649096 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-66f09a15-f32f-4aee-9df0-80b94a484cb0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Getting quotas for project 0761fde06e5240adb0d7f1a7d5724d37. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:35:12.654067 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-66f09a15-f32f-4aee-9df0-80b94a484cb0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Getting quotas for user c7ea83c1a5d34727943721cd91e7268d and project 0761fde06e5240adb0d7f1a7d5724d37. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:35:12.664745 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-66f09a15-f32f-4aee-9df0-80b94a484cb0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:35:12.667566 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-66f09a15-f32f-4aee-9df0-80b94a484cb0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf655d8c-fb2f-42ef-a7a7-0386f57b58cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:35:12.716217 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-66f09a15-f32f-4aee-9df0-80b94a484cb0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.569438 Oct 17 04:35:12.716821 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 265/520] 10.222.0.40 () {62 vars in 1188 bytes} [Mon Oct 17 04:35:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 04:35:12.729405 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7c09ecf1-5b5c-4462-a6e1-dfed0a03a625 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:12.730036 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7c09ecf1-5b5c-4462-a6e1-dfed0a03a625 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:12.783312 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-7c09ecf1-5b5c-4462-a6e1-dfed0a03a625 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:12.791114 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-7c09ecf1-5b5c-4462-a6e1-dfed0a03a625 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:12.792584 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-7c09ecf1-5b5c-4462-a6e1-dfed0a03a625 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:12.793719 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7c09ecf1-5b5c-4462-a6e1-dfed0a03a625 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1280 microversion: 2.20 time: 0.069648 Oct 17 04:35:12.794380 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 256/521] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:35:12 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:35:13.819908 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-875fd60a-8b7e-43da-ab77-42a7d5265e8a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:13.820458 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-875fd60a-8b7e-43da-ab77-42a7d5265e8a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:13.830000 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-875fd60a-8b7e-43da-ab77-42a7d5265e8a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:13.830480 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-875fd60a-8b7e-43da-ab77-42a7d5265e8a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:13.830908 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-875fd60a-8b7e-43da-ab77-42a7d5265e8a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:13.831595 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-875fd60a-8b7e-43da-ab77-42a7d5265e8a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:13.832037 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-875fd60a-8b7e-43da-ab77-42a7d5265e8a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:13.832457 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-875fd60a-8b7e-43da-ab77-42a7d5265e8a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:13.894689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-875fd60a-8b7e-43da-ab77-42a7d5265e8a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:13.903745 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-875fd60a-8b7e-43da-ab77-42a7d5265e8a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:13.905431 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-875fd60a-8b7e-43da-ab77-42a7d5265e8a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:13.906559 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-875fd60a-8b7e-43da-ab77-42a7d5265e8a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1332 microversion: 2.20 time: 0.091489 Oct 17 04:35:13.907109 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 266/522] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:35:13 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1332 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:35:14.932702 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0f17e56f-79a5-4dc3-af8b-fcdf1a928a42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:14.933250 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0f17e56f-79a5-4dc3-af8b-fcdf1a928a42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:14.939813 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f17e56f-79a5-4dc3-af8b-fcdf1a928a42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:14.940296 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f17e56f-79a5-4dc3-af8b-fcdf1a928a42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:14.940726 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f17e56f-79a5-4dc3-af8b-fcdf1a928a42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:14.941456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f17e56f-79a5-4dc3-af8b-fcdf1a928a42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:14.941887 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f17e56f-79a5-4dc3-af8b-fcdf1a928a42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:14.942306 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f17e56f-79a5-4dc3-af8b-fcdf1a928a42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:15.079279 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-0f17e56f-79a5-4dc3-af8b-fcdf1a928a42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:15.087404 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-0f17e56f-79a5-4dc3-af8b-fcdf1a928a42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:15.089601 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-0f17e56f-79a5-4dc3-af8b-fcdf1a928a42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:15.090720 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0f17e56f-79a5-4dc3-af8b-fcdf1a928a42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1405 microversion: 2.20 time: 0.162754 Oct 17 04:35:15.091521 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 257/523] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:35:14 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:35:15.315430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-f36a4305-debc-4517-bbe2-ec7012f71377 req-d2b349d7-8e92-44ed-99f3-7b1a38117697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e58170c9-886a-45c1-9c0e-acfb37fab782", "tag": "0c4b79b8-f091-4221-b5d8-ad21adc83468"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:35:15.329313 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f36a4305-debc-4517-bbe2-ec7012f71377 req-d2b349d7-8e92-44ed-99f3-7b1a38117697 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:15.329799 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f36a4305-debc-4517-bbe2-ec7012f71377 req-d2b349d7-8e92-44ed-99f3-7b1a38117697 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:15.330460 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f36a4305-debc-4517-bbe2-ec7012f71377 req-d2b349d7-8e92-44ed-99f3-7b1a38117697 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:15.342283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-f36a4305-debc-4517-bbe2-ec7012f71377 req-d2b349d7-8e92-44ed-99f3-7b1a38117697 service nova] Creating event network-changed:0c4b79b8-f091-4221-b5d8-ad21adc83468 for instance e58170c9-886a-45c1-9c0e-acfb37fab782 on hv-cinder-86155 Oct 17 04:35:15.348025 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-f36a4305-debc-4517-bbe2-ec7012f71377 req-d2b349d7-8e92-44ed-99f3-7b1a38117697 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036305 Oct 17 04:35:15.349164 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 267/524] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:35:16.115672 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f502d6e9-f626-471c-af4d-c84d78217fce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:16.116279 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f502d6e9-f626-471c-af4d-c84d78217fce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:16.123824 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f502d6e9-f626-471c-af4d-c84d78217fce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:16.124302 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f502d6e9-f626-471c-af4d-c84d78217fce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:16.124732 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f502d6e9-f626-471c-af4d-c84d78217fce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:16.125463 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f502d6e9-f626-471c-af4d-c84d78217fce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:16.125883 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f502d6e9-f626-471c-af4d-c84d78217fce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:16.126301 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f502d6e9-f626-471c-af4d-c84d78217fce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:16.254365 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f502d6e9-f626-471c-af4d-c84d78217fce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:16.262974 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f502d6e9-f626-471c-af4d-c84d78217fce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:16.264405 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f502d6e9-f626-471c-af4d-c84d78217fce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:16.265527 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f502d6e9-f626-471c-af4d-c84d78217fce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1405 microversion: 2.20 time: 0.153733 Oct 17 04:35:16.266076 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 258/525] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:35:16 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:35:17.290827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9dc42a9d-a00c-4e59-9fbc-9bb6650c82e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:17.291527 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9dc42a9d-a00c-4e59-9fbc-9bb6650c82e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:17.298971 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9dc42a9d-a00c-4e59-9fbc-9bb6650c82e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:17.299444 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9dc42a9d-a00c-4e59-9fbc-9bb6650c82e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:17.299874 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9dc42a9d-a00c-4e59-9fbc-9bb6650c82e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:17.300557 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9dc42a9d-a00c-4e59-9fbc-9bb6650c82e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:17.301005 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9dc42a9d-a00c-4e59-9fbc-9bb6650c82e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:17.301453 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9dc42a9d-a00c-4e59-9fbc-9bb6650c82e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:17.431656 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-9dc42a9d-a00c-4e59-9fbc-9bb6650c82e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:17.439633 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-9dc42a9d-a00c-4e59-9fbc-9bb6650c82e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:17.441093 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-9dc42a9d-a00c-4e59-9fbc-9bb6650c82e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:17.442202 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9dc42a9d-a00c-4e59-9fbc-9bb6650c82e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1405 microversion: 2.20 time: 0.155700 Oct 17 04:35:17.442755 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 268/526] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:35:17 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:35:18.467638 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0614206f-3a09-48f6-9550-b07de773bd5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:18.468247 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0614206f-3a09-48f6-9550-b07de773bd5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:18.474606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0614206f-3a09-48f6-9550-b07de773bd5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:18.475090 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0614206f-3a09-48f6-9550-b07de773bd5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:18.475521 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0614206f-3a09-48f6-9550-b07de773bd5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:18.476214 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0614206f-3a09-48f6-9550-b07de773bd5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:18.476668 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0614206f-3a09-48f6-9550-b07de773bd5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:18.477111 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0614206f-3a09-48f6-9550-b07de773bd5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:18.608852 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-0614206f-3a09-48f6-9550-b07de773bd5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:18.616878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-0614206f-3a09-48f6-9550-b07de773bd5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:18.618389 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-0614206f-3a09-48f6-9550-b07de773bd5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:18.619479 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0614206f-3a09-48f6-9550-b07de773bd5f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1405 microversion: 2.20 time: 0.156153 Oct 17 04:35:18.620033 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 259/527] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:35:18 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:35:19.643778 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f5f3bef8-5fe8-41f0-8591-9e6cde838931 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:19.644392 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f5f3bef8-5fe8-41f0-8591-9e6cde838931 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:19.650790 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5f3bef8-5fe8-41f0-8591-9e6cde838931 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:19.651274 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5f3bef8-5fe8-41f0-8591-9e6cde838931 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:19.651713 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5f3bef8-5fe8-41f0-8591-9e6cde838931 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:19.652407 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5f3bef8-5fe8-41f0-8591-9e6cde838931 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:19.652866 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5f3bef8-5fe8-41f0-8591-9e6cde838931 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:19.653327 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f5f3bef8-5fe8-41f0-8591-9e6cde838931 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:19.782012 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f5f3bef8-5fe8-41f0-8591-9e6cde838931 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:19.789938 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f5f3bef8-5fe8-41f0-8591-9e6cde838931 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:19.791385 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f5f3bef8-5fe8-41f0-8591-9e6cde838931 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:19.792480 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f5f3bef8-5fe8-41f0-8591-9e6cde838931 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1405 microversion: 2.20 time: 0.152642 Oct 17 04:35:19.793597 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 269/528] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:35:19 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:35:20.480809 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-e8097ed5-3578-4e93-afb7-4caae1fdc1a3 req-45fd8bed-e287-42b1-974d-f7557a5bcc4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58170c9-886a-45c1-9c0e-acfb37fab782", "name": "network-vif-plugged", "status": "completed", "tag": "0c4b79b8-f091-4221-b5d8-ad21adc83468"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:35:20.491568 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e8097ed5-3578-4e93-afb7-4caae1fdc1a3 req-45fd8bed-e287-42b1-974d-f7557a5bcc4e service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:20.492051 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e8097ed5-3578-4e93-afb7-4caae1fdc1a3 req-45fd8bed-e287-42b1-974d-f7557a5bcc4e service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:20.492483 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-e8097ed5-3578-4e93-afb7-4caae1fdc1a3 req-45fd8bed-e287-42b1-974d-f7557a5bcc4e service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:20.503447 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-e8097ed5-3578-4e93-afb7-4caae1fdc1a3 req-45fd8bed-e287-42b1-974d-f7557a5bcc4e service nova] Creating event network-vif-plugged:0c4b79b8-f091-4221-b5d8-ad21adc83468 for instance e58170c9-886a-45c1-9c0e-acfb37fab782 on hv-cinder-86155 Oct 17 04:35:20.508329 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-e8097ed5-3578-4e93-afb7-4caae1fdc1a3 req-45fd8bed-e287-42b1-974d-f7557a5bcc4e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031273 Oct 17 04:35:20.508915 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 260/529] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:35:20.818185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f42f47bd-ff0e-4548-8c20-c418ef6168b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:20.818792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f42f47bd-ff0e-4548-8c20-c418ef6168b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:20.825312 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f42f47bd-ff0e-4548-8c20-c418ef6168b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:20.826430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f42f47bd-ff0e-4548-8c20-c418ef6168b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:20.826879 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f42f47bd-ff0e-4548-8c20-c418ef6168b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:20.827832 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f42f47bd-ff0e-4548-8c20-c418ef6168b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:20.828284 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f42f47bd-ff0e-4548-8c20-c418ef6168b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:20.828707 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f42f47bd-ff0e-4548-8c20-c418ef6168b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:20.957529 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f42f47bd-ff0e-4548-8c20-c418ef6168b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:20.966078 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f42f47bd-ff0e-4548-8c20-c418ef6168b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:20.967534 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f42f47bd-ff0e-4548-8c20-c418ef6168b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:20.968630 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f42f47bd-ff0e-4548-8c20-c418ef6168b1 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1405 microversion: 2.20 time: 0.154395 Oct 17 04:35:20.969218 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 270/530] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:35:20 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:35:21.994172 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1d135d52-4607-4c13-a3b5-327a8b9046f3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:21.994876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1d135d52-4607-4c13-a3b5-327a8b9046f3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:22.002028 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d135d52-4607-4c13-a3b5-327a8b9046f3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:22.002515 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d135d52-4607-4c13-a3b5-327a8b9046f3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:22.002953 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d135d52-4607-4c13-a3b5-327a8b9046f3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:22.003702 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d135d52-4607-4c13-a3b5-327a8b9046f3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:22.004158 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d135d52-4607-4c13-a3b5-327a8b9046f3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:22.004586 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d135d52-4607-4c13-a3b5-327a8b9046f3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:22.132515 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-1d135d52-4607-4c13-a3b5-327a8b9046f3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:22.142205 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-1d135d52-4607-4c13-a3b5-327a8b9046f3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:22.143645 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-1d135d52-4607-4c13-a3b5-327a8b9046f3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:22.144738 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1d135d52-4607-4c13-a3b5-327a8b9046f3 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1405 microversion: 2.20 time: 0.155302 Oct 17 04:35:22.145359 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 261/531] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:35:21 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:35:23.170663 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e1a00300-a55d-4046-99cd-fbff9d13e343 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:23.171280 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e1a00300-a55d-4046-99cd-fbff9d13e343 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:23.173706 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:35:23.174503 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:35:23.180424 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1a00300-a55d-4046-99cd-fbff9d13e343 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:23.180911 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1a00300-a55d-4046-99cd-fbff9d13e343 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:23.181379 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1a00300-a55d-4046-99cd-fbff9d13e343 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:23.182080 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1a00300-a55d-4046-99cd-fbff9d13e343 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:23.182541 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1a00300-a55d-4046-99cd-fbff9d13e343 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:23.182999 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1a00300-a55d-4046-99cd-fbff9d13e343 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:23.318282 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e1a00300-a55d-4046-99cd-fbff9d13e343 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:23.327064 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e1a00300-a55d-4046-99cd-fbff9d13e343 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:23.328836 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e1a00300-a55d-4046-99cd-fbff9d13e343 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:23.330029 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e1a00300-a55d-4046-99cd-fbff9d13e343 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1596 microversion: 2.20 time: 0.163358 Oct 17 04:35:23.330599 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 271/532] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:35:23 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1596 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:35:23.354637 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c77974f9-f76a-4d86-990f-f268991df11f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:23.355143 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c77974f9-f76a-4d86-990f-f268991df11f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:23.357043 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:35:23.362810 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c77974f9-f76a-4d86-990f-f268991df11f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:23.363285 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c77974f9-f76a-4d86-990f-f268991df11f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:23.363712 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c77974f9-f76a-4d86-990f-f268991df11f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:23.364399 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c77974f9-f76a-4d86-990f-f268991df11f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:23.364844 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c77974f9-f76a-4d86-990f-f268991df11f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:23.365288 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c77974f9-f76a-4d86-990f-f268991df11f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:23.440232 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c77974f9-f76a-4d86-990f-f268991df11f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089473 Oct 17 04:35:23.440822 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 262/533] 10.222.0.40 () {60 vars in 1316 bytes} [Mon Oct 17 04:35:23 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 04:35:24.354575 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-5cce9116-f9dd-476e-9204-817f3fb0b411 req-2a3318d2-eb38-44c1-9135-2aa96c3f540b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e58170c9-886a-45c1-9c0e-acfb37fab782", "tag": "0c4b79b8-f091-4221-b5d8-ad21adc83468"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:35:24.365352 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5cce9116-f9dd-476e-9204-817f3fb0b411 req-2a3318d2-eb38-44c1-9135-2aa96c3f540b service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:24.365926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5cce9116-f9dd-476e-9204-817f3fb0b411 req-2a3318d2-eb38-44c1-9135-2aa96c3f540b service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:24.366436 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5cce9116-f9dd-476e-9204-817f3fb0b411 req-2a3318d2-eb38-44c1-9135-2aa96c3f540b service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:24.378707 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-5cce9116-f9dd-476e-9204-817f3fb0b411 req-2a3318d2-eb38-44c1-9135-2aa96c3f540b service nova] Creating event network-changed:0c4b79b8-f091-4221-b5d8-ad21adc83468 for instance e58170c9-886a-45c1-9c0e-acfb37fab782 on hv-cinder-86155 Oct 17 04:35:24.383546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-5cce9116-f9dd-476e-9204-817f3fb0b411 req-2a3318d2-eb38-44c1-9135-2aa96c3f540b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032761 Oct 17 04:35:24.384390 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 272/534] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:35:25.598277 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5797e81a-d3a8-4627-9c4e-4ae27aef979a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:25.598784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5797e81a-d3a8-4627-9c4e-4ae27aef979a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:25.604623 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5797e81a-d3a8-4627-9c4e-4ae27aef979a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:25.605125 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5797e81a-d3a8-4627-9c4e-4ae27aef979a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:25.605559 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5797e81a-d3a8-4627-9c4e-4ae27aef979a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:25.606861 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5797e81a-d3a8-4627-9c4e-4ae27aef979a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:25.607309 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5797e81a-d3a8-4627-9c4e-4ae27aef979a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:25.607729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5797e81a-d3a8-4627-9c4e-4ae27aef979a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:25.686545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-5797e81a-d3a8-4627-9c4e-4ae27aef979a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lazy-loading 'services' on Instance uuid e5722cf2-3e88-4c8e-a533-e6a228c13a82 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:35:25.757267 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5797e81a-d3a8-4627-9c4e-4ae27aef979a tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82/os-volume_attachments/a78de63d-2c53-4c69-b85c-68a82e156cb0" status: 202 len: 0 microversion: 2.1 time: 0.163343 Oct 17 04:35:25.757859 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 263/535] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Oct 17 04:35:25 2022] DELETE /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82/os-volume_attachments/a78de63d-2c53-4c69-b85c-68a82e156cb0 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:35:25.766920 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fbc67c52-e332-435f-a87b-5b6a284960a8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:25.769184 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fbc67c52-e332-435f-a87b-5b6a284960a8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:25.776142 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbc67c52-e332-435f-a87b-5b6a284960a8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:25.776630 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbc67c52-e332-435f-a87b-5b6a284960a8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:25.777197 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbc67c52-e332-435f-a87b-5b6a284960a8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:25.778426 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbc67c52-e332-435f-a87b-5b6a284960a8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:25.778951 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbc67c52-e332-435f-a87b-5b6a284960a8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:25.779377 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-fbc67c52-e332-435f-a87b-5b6a284960a8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:25.810632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fbc67c52-e332-435f-a87b-5b6a284960a8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048204 Oct 17 04:35:25.811201 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 273/536] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:35:25 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:35:26.823979 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-46368afb-69de-42f3-8b06-cb603bcec441 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:26.826808 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-46368afb-69de-42f3-8b06-cb603bcec441 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:26.833275 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46368afb-69de-42f3-8b06-cb603bcec441 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:26.833806 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46368afb-69de-42f3-8b06-cb603bcec441 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:26.834241 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46368afb-69de-42f3-8b06-cb603bcec441 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:26.834921 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46368afb-69de-42f3-8b06-cb603bcec441 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:26.835370 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46368afb-69de-42f3-8b06-cb603bcec441 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:26.835790 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-46368afb-69de-42f3-8b06-cb603bcec441 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:26.864995 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-46368afb-69de-42f3-8b06-cb603bcec441 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045867 Oct 17 04:35:26.865568 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 264/537] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:35:26 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 04:35:26.944863 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-48e18da2-7aa7-4da1-9050-c9f33d52267c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:26.945424 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-48e18da2-7aa7-4da1-9050-c9f33d52267c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:26.952263 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48e18da2-7aa7-4da1-9050-c9f33d52267c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:26.953000 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48e18da2-7aa7-4da1-9050-c9f33d52267c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:26.953454 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48e18da2-7aa7-4da1-9050-c9f33d52267c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:26.954133 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48e18da2-7aa7-4da1-9050-c9f33d52267c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:26.954579 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48e18da2-7aa7-4da1-9050-c9f33d52267c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:26.955002 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-48e18da2-7aa7-4da1-9050-c9f33d52267c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:26.979347 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-48e18da2-7aa7-4da1-9050-c9f33d52267c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:35:27.053163 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-48e18da2-7aa7-4da1-9050-c9f33d52267c tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 204 len: 0 microversion: 2.1 time: 0.111836 Oct 17 04:35:27.053946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 274/538] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:35:26 2022] DELETE /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:35:27.062254 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f61cd405-2bd2-418c-bab1-68cc9edc1d29 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:27.062906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f61cd405-2bd2-418c-bab1-68cc9edc1d29 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:27.069372 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f61cd405-2bd2-418c-bab1-68cc9edc1d29 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:27.069909 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f61cd405-2bd2-418c-bab1-68cc9edc1d29 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:27.070337 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f61cd405-2bd2-418c-bab1-68cc9edc1d29 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:27.071172 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f61cd405-2bd2-418c-bab1-68cc9edc1d29 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:27.071779 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f61cd405-2bd2-418c-bab1-68cc9edc1d29 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:27.072212 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f61cd405-2bd2-418c-bab1-68cc9edc1d29 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:27.201179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f61cd405-2bd2-418c-bab1-68cc9edc1d29 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:27.208992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f61cd405-2bd2-418c-bab1-68cc9edc1d29 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1688 microversion: 2.1 time: 0.151169 Oct 17 04:35:27.209580 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 265/539] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:27 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:28.232434 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-764d4870-da38-4935-8b6d-e10343741c38 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:28.233063 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-764d4870-da38-4935-8b6d-e10343741c38 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:28.239465 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-764d4870-da38-4935-8b6d-e10343741c38 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:28.239943 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-764d4870-da38-4935-8b6d-e10343741c38 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:28.240379 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-764d4870-da38-4935-8b6d-e10343741c38 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:28.241062 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-764d4870-da38-4935-8b6d-e10343741c38 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:28.241560 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-764d4870-da38-4935-8b6d-e10343741c38 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:28.241982 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-764d4870-da38-4935-8b6d-e10343741c38 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:28.368542 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-764d4870-da38-4935-8b6d-e10343741c38 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:28.376274 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-764d4870-da38-4935-8b6d-e10343741c38 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1688 microversion: 2.1 time: 0.148221 Oct 17 04:35:28.376838 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 275/540] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:28 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:29.400046 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fcd5e401-43db-40f0-bed7-1ac15a49a90b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:29.400821 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fcd5e401-43db-40f0-bed7-1ac15a49a90b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:29.407662 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcd5e401-43db-40f0-bed7-1ac15a49a90b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:29.408148 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcd5e401-43db-40f0-bed7-1ac15a49a90b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:29.408586 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcd5e401-43db-40f0-bed7-1ac15a49a90b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:29.409309 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcd5e401-43db-40f0-bed7-1ac15a49a90b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:29.409773 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcd5e401-43db-40f0-bed7-1ac15a49a90b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:29.410203 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fcd5e401-43db-40f0-bed7-1ac15a49a90b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:29.544866 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-fcd5e401-43db-40f0-bed7-1ac15a49a90b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:29.552561 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fcd5e401-43db-40f0-bed7-1ac15a49a90b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1688 microversion: 2.1 time: 0.156831 Oct 17 04:35:29.553212 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 266/541] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:29 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:30.576096 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-56888f99-5156-4707-985f-07e0f86fb63f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:30.576621 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-56888f99-5156-4707-985f-07e0f86fb63f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:30.579343 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:35:30.585606 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56888f99-5156-4707-985f-07e0f86fb63f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:30.586088 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56888f99-5156-4707-985f-07e0f86fb63f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:30.586523 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56888f99-5156-4707-985f-07e0f86fb63f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:30.587209 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56888f99-5156-4707-985f-07e0f86fb63f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:30.587660 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56888f99-5156-4707-985f-07e0f86fb63f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:30.588105 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-56888f99-5156-4707-985f-07e0f86fb63f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:30.722059 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-56888f99-5156-4707-985f-07e0f86fb63f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:30.729872 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-56888f99-5156-4707-985f-07e0f86fb63f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1688 microversion: 2.1 time: 0.158187 Oct 17 04:35:30.739117 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 276/542] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:30 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:31.756973 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-27aec018-6f55-42ed-a740-aba229866357 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:31.758300 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-27aec018-6f55-42ed-a740-aba229866357 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:31.764938 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27aec018-6f55-42ed-a740-aba229866357 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:31.765532 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27aec018-6f55-42ed-a740-aba229866357 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:31.766032 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27aec018-6f55-42ed-a740-aba229866357 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:31.766794 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27aec018-6f55-42ed-a740-aba229866357 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:31.767310 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27aec018-6f55-42ed-a740-aba229866357 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:31.767808 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-27aec018-6f55-42ed-a740-aba229866357 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:31.795440 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b2f68036-13a0-49b5-9f8f-97fa9a7eee36 req-f5b2fc50-626a-4c8e-a9dc-a6185353e82e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5722cf2-3e88-4c8e-a533-e6a228c13a82", "name": "network-vif-deleted", "tag": "d6e73103-0bcc-46c6-a3be-e7d793fb4195"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:35:31.819622 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b2f68036-13a0-49b5-9f8f-97fa9a7eee36 req-f5b2fc50-626a-4c8e-a9dc-a6185353e82e service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:31.820270 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b2f68036-13a0-49b5-9f8f-97fa9a7eee36 req-f5b2fc50-626a-4c8e-a9dc-a6185353e82e service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:31.820943 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b2f68036-13a0-49b5-9f8f-97fa9a7eee36 req-f5b2fc50-626a-4c8e-a9dc-a6185353e82e service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:31.851183 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-27aec018-6f55-42ed-a740-aba229866357 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:31.860578 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b2f68036-13a0-49b5-9f8f-97fa9a7eee36 req-f5b2fc50-626a-4c8e-a9dc-a6185353e82e service nova] Creating event network-vif-deleted:d6e73103-0bcc-46c6-a3be-e7d793fb4195 for instance e5722cf2-3e88-4c8e-a533-e6a228c13a82 on hv-cinder-86155 Oct 17 04:35:31.863812 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-27aec018-6f55-42ed-a740-aba229866357 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 200 len: 1621 microversion: 2.1 time: 0.112220 Oct 17 04:35:31.864316 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 267/543] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:31 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 1621 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:31.867060 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b2f68036-13a0-49b5-9f8f-97fa9a7eee36 req-f5b2fc50-626a-4c8e-a9dc-a6185353e82e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076539 Oct 17 04:35:31.867706 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 277/544] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:35:32.891817 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-79babae2-324f-475d-ac6b-326bc0056597 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:32.892429 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-79babae2-324f-475d-ac6b-326bc0056597 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: e5722cf2-3e88-4c8e-a533-e6a228c13a82] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:32.899427 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79babae2-324f-475d-ac6b-326bc0056597 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:32.900163 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79babae2-324f-475d-ac6b-326bc0056597 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:32.900890 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79babae2-324f-475d-ac6b-326bc0056597 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:32.901760 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79babae2-324f-475d-ac6b-326bc0056597 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:32.902275 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79babae2-324f-475d-ac6b-326bc0056597 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:32.903279 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-79babae2-324f-475d-ac6b-326bc0056597 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:32.916958 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-79babae2-324f-475d-ac6b-326bc0056597 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] HTTP exception thrown: Instance e5722cf2-3e88-4c8e-a533-e6a228c13a82 could not be found. Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-79babae2-324f-475d-ac6b-326bc0056597 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Request method failure captured: Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 HTTP/1.1 Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNqLhF-1OXgaOje4IGVnyezHko7_IZT00YPv9us17-37Q37nMNiHcC_lb8w7eKgJVeRiaXu6_GEjnJM1-HP1OhzVwjZNUQ6agiLoG5Dn6ckIJuDrH2TmKCF4QrHIDvZud13RDaxZYvs15jYkMJ96cW5VSzZewYAyctO5HLh7B5QnLlI Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: 7bd6234b23704bdf809481085ce465eb Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-438926643 Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:35:32.918893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:35:32.920538 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7bd6234b23704bdf809481085ce465eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7bd6234b23704bdf809481085ce465eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7bd6234b23704bdf809481085ce465eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7bd6234b23704bdf809481085ce465eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:35:32.920538 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-ServerRescueNegativeTestJSON-438926643 Oct 17 04:35:32.920538 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: 7bd6234b23704bdf809481085ce465eb Oct 17 04:35:32.920538 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-438926643 Oct 17 04:35:32.920538 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-ServerRescueNegativeTestJSON-438926643-project Oct 17 04:35:32.920538 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:35:32.920538 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:35:32.920538 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: 308c01bc66224188aec055c2397a066b Oct 17 04:35:32.920538 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-ServerRescueNegativeTestJSON-438926643-project Oct 17 04:35:32.920538 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:35:32.920538 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance e5722cf2-3e88-4c8e-a533-e6a228c13a82 could not be found. Oct 17 04:35:32.920538 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': 'e5722cf2-3e88-4c8e-a533-e6a228c13a82'} Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5722cf2-3e88-4c8e-a533-e6a228c13a82 could not be found. Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:35:32.921436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:35:32.922728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:35:32.922728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:35:32.922728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:35:32.922728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:35:32.922728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:35:32.922728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:35:32.922728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:35:32.922728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5722cf2-3e88-4c8e-a533-e6a228c13a82 could not be found. Oct 17 04:35:32.922728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:35:32.922728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:35:32.922728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:35:32.922728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:35:32.922728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:35:32.922728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:35:32.922728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:35:32.922728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:35:32.922728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5722cf2-3e88-4c8e-a533-e6a228c13a82 could not be found. Oct 17 04:35:32.922728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:35:32.923823 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-79babae2-324f-475d-ac6b-326bc0056597 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Returning 404 to user: Instance e5722cf2-3e88-4c8e-a533-e6a228c13a82 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:35:32.923823 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-79babae2-324f-475d-ac6b-326bc0056597 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82" status: 404 len: 111 microversion: 2.1 time: 0.033298 Oct 17 04:35:32.923823 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 268/545] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:32 2022] GET /compute/v2.1/servers/e5722cf2-3e88-4c8e-a533-e6a228c13a82 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:35:32.929789 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-88278238-c352-4942-b938-f8e8a20e3210 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '.version_select at 0x7fc630e523a0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:32.949214 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-88278238-c352-4942-b938-f8e8a20e3210 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1239879014" status: 202 len: 0 microversion: 2.1 time: 0.023434 Oct 17 04:35:32.950800 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 278/546] 10.222.0.40 () {58 vars in 1221 bytes} [Mon Oct 17 04:35:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1239879014 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:35:33.096871 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d67693e4-1f67-49c9-8b12-c27c8b6eca85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:33.099158 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d67693e4-1f67-49c9-8b12-c27c8b6eca85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:33.106423 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d67693e4-1f67-49c9-8b12-c27c8b6eca85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:33.107356 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d67693e4-1f67-49c9-8b12-c27c8b6eca85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:33.107356 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d67693e4-1f67-49c9-8b12-c27c8b6eca85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:33.107901 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d67693e4-1f67-49c9-8b12-c27c8b6eca85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:33.108909 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d67693e4-1f67-49c9-8b12-c27c8b6eca85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:33.108909 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d67693e4-1f67-49c9-8b12-c27c8b6eca85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:33.142509 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d67693e4-1f67-49c9-8b12-c27c8b6eca85 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050296 Oct 17 04:35:33.143145 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 269/547] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:35:33 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 04:35:33.207320 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-548bf506-73f0-4089-aa31-8fd87f91d7d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:33.207849 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-548bf506-73f0-4089-aa31-8fd87f91d7d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:33.214069 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-548bf506-73f0-4089-aa31-8fd87f91d7d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:33.214559 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-548bf506-73f0-4089-aa31-8fd87f91d7d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:33.215127 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-548bf506-73f0-4089-aa31-8fd87f91d7d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:33.216023 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-548bf506-73f0-4089-aa31-8fd87f91d7d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:33.216651 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-548bf506-73f0-4089-aa31-8fd87f91d7d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:33.217088 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-548bf506-73f0-4089-aa31-8fd87f91d7d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:33.243543 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-548bf506-73f0-4089-aa31-8fd87f91d7d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:35:33.318839 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-548bf506-73f0-4089-aa31-8fd87f91d7d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 204 len: 0 microversion: 2.1 time: 0.115148 Oct 17 04:35:33.319675 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 279/548] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:35:33 2022] DELETE /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:35:33.328380 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c6087e7e-5601-4e8b-97e6-502adc7d3f40 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:33.329017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c6087e7e-5601-4e8b-97e6-502adc7d3f40 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:33.334859 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6087e7e-5601-4e8b-97e6-502adc7d3f40 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:33.335343 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6087e7e-5601-4e8b-97e6-502adc7d3f40 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:33.335981 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6087e7e-5601-4e8b-97e6-502adc7d3f40 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:33.336675 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6087e7e-5601-4e8b-97e6-502adc7d3f40 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:33.337315 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6087e7e-5601-4e8b-97e6-502adc7d3f40 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:33.337740 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c6087e7e-5601-4e8b-97e6-502adc7d3f40 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:33.473904 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-c6087e7e-5601-4e8b-97e6-502adc7d3f40 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:33.484139 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c6087e7e-5601-4e8b-97e6-502adc7d3f40 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1673 microversion: 2.1 time: 0.160228 Oct 17 04:35:33.484711 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 270/549] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:33 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:34.507995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9cd79370-b525-4377-a76c-9ff47c28098f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:34.508693 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9cd79370-b525-4377-a76c-9ff47c28098f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:34.515225 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9cd79370-b525-4377-a76c-9ff47c28098f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:34.515710 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9cd79370-b525-4377-a76c-9ff47c28098f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:34.516147 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9cd79370-b525-4377-a76c-9ff47c28098f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:34.516835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9cd79370-b525-4377-a76c-9ff47c28098f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:34.517315 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9cd79370-b525-4377-a76c-9ff47c28098f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:34.517738 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9cd79370-b525-4377-a76c-9ff47c28098f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:34.646415 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-9cd79370-b525-4377-a76c-9ff47c28098f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:34.654845 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9cd79370-b525-4377-a76c-9ff47c28098f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1673 microversion: 2.1 time: 0.151021 Oct 17 04:35:34.655395 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 280/550] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:34 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:35:35.678851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f8d3dcad-565e-442b-bef5-1525b7d06845 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:35.679407 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f8d3dcad-565e-442b-bef5-1525b7d06845 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:35.681823 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:35:35.688299 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8d3dcad-565e-442b-bef5-1525b7d06845 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:35.688781 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8d3dcad-565e-442b-bef5-1525b7d06845 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:35.689253 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8d3dcad-565e-442b-bef5-1525b7d06845 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:35.689948 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8d3dcad-565e-442b-bef5-1525b7d06845 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:35.690395 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8d3dcad-565e-442b-bef5-1525b7d06845 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:35.690816 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8d3dcad-565e-442b-bef5-1525b7d06845 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:35.822489 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f8d3dcad-565e-442b-bef5-1525b7d06845 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:35.832580 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f8d3dcad-565e-442b-bef5-1525b7d06845 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1673 microversion: 2.1 time: 0.156707 Oct 17 04:35:35.832580 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 271/551] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:35 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:35.837813 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-be35b062-5d0b-4201-81fc-e63c2fee0b8f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:35.838319 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-be35b062-5d0b-4201-81fc-e63c2fee0b8f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:35.844851 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be35b062-5d0b-4201-81fc-e63c2fee0b8f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:35.845363 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be35b062-5d0b-4201-81fc-e63c2fee0b8f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:35.846013 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be35b062-5d0b-4201-81fc-e63c2fee0b8f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:35.846714 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be35b062-5d0b-4201-81fc-e63c2fee0b8f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:35.847199 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be35b062-5d0b-4201-81fc-e63c2fee0b8f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:35.847625 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-be35b062-5d0b-4201-81fc-e63c2fee0b8f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:35.865907 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:35:35.875995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-be35b062-5d0b-4201-81fc-e63c2fee0b8f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:35:35.957105 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-be35b062-5d0b-4201-81fc-e63c2fee0b8f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "DELETE /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 204 len: 0 microversion: 2.1 time: 0.122669 Oct 17 04:35:35.957677 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 281/552] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:35:35 2022] DELETE /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:35:35.966342 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a2b96d6-52e6-44bc-81f4-43bd6ea6ef13 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:35.966963 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2a2b96d6-52e6-44bc-81f4-43bd6ea6ef13 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:35.973557 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a2b96d6-52e6-44bc-81f4-43bd6ea6ef13 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:35.974053 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a2b96d6-52e6-44bc-81f4-43bd6ea6ef13 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:35.974480 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a2b96d6-52e6-44bc-81f4-43bd6ea6ef13 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:35.975171 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a2b96d6-52e6-44bc-81f4-43bd6ea6ef13 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:35.975624 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a2b96d6-52e6-44bc-81f4-43bd6ea6ef13 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:35.976047 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a2b96d6-52e6-44bc-81f4-43bd6ea6ef13 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:36.109637 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-2a2b96d6-52e6-44bc-81f4-43bd6ea6ef13 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:36.119057 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2a2b96d6-52e6-44bc-81f4-43bd6ea6ef13 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1507 microversion: 2.1 time: 0.157048 Oct 17 04:35:36.119920 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 272/553] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:35 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:35:36.371398 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-af836b9c-7d6d-4632-b73a-6a9482a99647 req-0da1ef07-56e8-4e26-9aea-9e883b4394c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf59bfb1-79b1-4ebe-9635-380231dec617", "name": "network-vif-deleted", "tag": "1b48d51f-4326-473b-8c9d-416ea81fac1e"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:35:36.380565 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-af836b9c-7d6d-4632-b73a-6a9482a99647 req-0da1ef07-56e8-4e26-9aea-9e883b4394c1 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:36.381044 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-af836b9c-7d6d-4632-b73a-6a9482a99647 req-0da1ef07-56e8-4e26-9aea-9e883b4394c1 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:36.381505 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-af836b9c-7d6d-4632-b73a-6a9482a99647 req-0da1ef07-56e8-4e26-9aea-9e883b4394c1 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:36.393580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-af836b9c-7d6d-4632-b73a-6a9482a99647 req-0da1ef07-56e8-4e26-9aea-9e883b4394c1 service nova] Creating event network-vif-deleted:1b48d51f-4326-473b-8c9d-416ea81fac1e for instance bf59bfb1-79b1-4ebe-9635-380231dec617 on hv-cinder-86155 Oct 17 04:35:36.398402 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-af836b9c-7d6d-4632-b73a-6a9482a99647 req-0da1ef07-56e8-4e26-9aea-9e883b4394c1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031106 Oct 17 04:35:36.399005 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 282/554] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:35:36.855446 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-13142b36-89e4-4456-8439-63f88c67d9a9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:36.856601 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-13142b36-89e4-4456-8439-63f88c67d9a9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:36.862939 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13142b36-89e4-4456-8439-63f88c67d9a9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:36.863416 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13142b36-89e4-4456-8439-63f88c67d9a9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:36.863843 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13142b36-89e4-4456-8439-63f88c67d9a9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:36.864525 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13142b36-89e4-4456-8439-63f88c67d9a9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:36.864970 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13142b36-89e4-4456-8439-63f88c67d9a9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:36.865412 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13142b36-89e4-4456-8439-63f88c67d9a9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:36.883327 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:35:36.929130 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-13142b36-89e4-4456-8439-63f88c67d9a9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:36.936817 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-13142b36-89e4-4456-8439-63f88c67d9a9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1606 microversion: 2.1 time: 0.085241 Oct 17 04:35:36.937408 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 273/555] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:36 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1606 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:37.143480 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dc27ef12-45e6-4df2-b25a-4be969365ed8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:37.144175 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dc27ef12-45e6-4df2-b25a-4be969365ed8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:37.150414 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc27ef12-45e6-4df2-b25a-4be969365ed8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:37.150898 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc27ef12-45e6-4df2-b25a-4be969365ed8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:37.151331 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc27ef12-45e6-4df2-b25a-4be969365ed8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:37.152039 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc27ef12-45e6-4df2-b25a-4be969365ed8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:37.152686 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc27ef12-45e6-4df2-b25a-4be969365ed8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:37.153273 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dc27ef12-45e6-4df2-b25a-4be969365ed8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:37.289284 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-dc27ef12-45e6-4df2-b25a-4be969365ed8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:37.297568 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dc27ef12-45e6-4df2-b25a-4be969365ed8 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1507 microversion: 2.1 time: 0.158773 Oct 17 04:35:37.298169 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 283/556] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:37 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:37.959740 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-342ce145-99ec-41e3-a3d7-5dad09209f49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:37.960348 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-342ce145-99ec-41e3-a3d7-5dad09209f49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:37.967477 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-342ce145-99ec-41e3-a3d7-5dad09209f49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:37.967951 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-342ce145-99ec-41e3-a3d7-5dad09209f49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:37.968380 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-342ce145-99ec-41e3-a3d7-5dad09209f49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:37.969057 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-342ce145-99ec-41e3-a3d7-5dad09209f49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:37.969524 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-342ce145-99ec-41e3-a3d7-5dad09209f49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:37.969940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-342ce145-99ec-41e3-a3d7-5dad09209f49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:38.045051 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-342ce145-99ec-41e3-a3d7-5dad09209f49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:38.053053 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-342ce145-99ec-41e3-a3d7-5dad09209f49 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 200 len: 1606 microversion: 2.1 time: 0.097122 Oct 17 04:35:38.053757 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 274/557] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:37 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 1606 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:38.321000 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a29fd842-d85a-43d7-b4d8-adc3c95a9103 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:38.321883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a29fd842-d85a-43d7-b4d8-adc3c95a9103 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:38.329100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a29fd842-d85a-43d7-b4d8-adc3c95a9103 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:38.329584 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a29fd842-d85a-43d7-b4d8-adc3c95a9103 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:38.330015 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a29fd842-d85a-43d7-b4d8-adc3c95a9103 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:38.330703 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a29fd842-d85a-43d7-b4d8-adc3c95a9103 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:38.331213 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a29fd842-d85a-43d7-b4d8-adc3c95a9103 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:38.331631 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a29fd842-d85a-43d7-b4d8-adc3c95a9103 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:38.470412 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a29fd842-d85a-43d7-b4d8-adc3c95a9103 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:38.479068 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a29fd842-d85a-43d7-b4d8-adc3c95a9103 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 200 len: 1507 microversion: 2.1 time: 0.161845 Oct 17 04:35:38.479659 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 284/558] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:38 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:38.776941 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-0572d077-fc78-44cd-8137-8fb42a801949 req-c5d1b110-12aa-4dfb-aaad-dd8673471a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942796c5-f5b3-476a-ae21-dcaabf3bd8df", "name": "network-vif-deleted", "tag": "37d6f19d-2ed4-4803-ac7c-8e9517972bc6"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:35:38.786640 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0572d077-fc78-44cd-8137-8fb42a801949 req-c5d1b110-12aa-4dfb-aaad-dd8673471a5c service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:38.787202 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0572d077-fc78-44cd-8137-8fb42a801949 req-c5d1b110-12aa-4dfb-aaad-dd8673471a5c service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:38.787888 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0572d077-fc78-44cd-8137-8fb42a801949 req-c5d1b110-12aa-4dfb-aaad-dd8673471a5c service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:38.802657 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-0572d077-fc78-44cd-8137-8fb42a801949 req-c5d1b110-12aa-4dfb-aaad-dd8673471a5c service nova] Creating event network-vif-deleted:37d6f19d-2ed4-4803-ac7c-8e9517972bc6 for instance 942796c5-f5b3-476a-ae21-dcaabf3bd8df on hv-cinder-86155 Oct 17 04:35:38.808373 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-0572d077-fc78-44cd-8137-8fb42a801949 req-c5d1b110-12aa-4dfb-aaad-dd8673471a5c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035000 Oct 17 04:35:38.809564 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 275/559] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:35:39.076480 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc5c1cdb-f31a-4158-bc6a-9316b8e2ec5c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:39.077156 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bc5c1cdb-f31a-4158-bc6a-9316b8e2ec5c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:39.083426 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc5c1cdb-f31a-4158-bc6a-9316b8e2ec5c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:39.083914 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc5c1cdb-f31a-4158-bc6a-9316b8e2ec5c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:39.084365 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc5c1cdb-f31a-4158-bc6a-9316b8e2ec5c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:39.085057 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc5c1cdb-f31a-4158-bc6a-9316b8e2ec5c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:39.085538 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc5c1cdb-f31a-4158-bc6a-9316b8e2ec5c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:39.085967 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc5c1cdb-f31a-4158-bc6a-9316b8e2ec5c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:39.100930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-bc5c1cdb-f31a-4158-bc6a-9316b8e2ec5c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] HTTP exception thrown: Instance bf59bfb1-79b1-4ebe-9635-380231dec617 could not be found. Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc5c1cdb-f31a-4158-bc6a-9316b8e2ec5c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Request method failure captured: Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 HTTP/1.1 Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNqRUiXt4PHEZM45Sl2dRGKw92wrAMscBJB9ZAwCEDIPH2HxVsoMIKkUKFHPlERhunaUHlnBmKrDLC-749DjsE3-Tz_Ttygz1dTltMlQqDMBzpc2WOagOL29Oy1j5ERZPVQ95iO44jL5tdGPvvwoVWPS8zmeonSpbFiTmRzLyai1Uck Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: 9de6141e0c3a41bcb84ac635b48a51df Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeTestJSON-1936456196 Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:35:39.102657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:35:39.104358 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:35:39.104358 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeTestJSON-1936456196 Oct 17 04:35:39.104358 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: 9de6141e0c3a41bcb84ac635b48a51df Oct 17 04:35:39.104358 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1936456196 Oct 17 04:35:39.104358 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-AttachVolumeTestJSON-1936456196-project Oct 17 04:35:39.104358 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:35:39.104358 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:35:39.104358 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 78eac67939a44d0fa99cb748b56f7b70 Oct 17 04:35:39.104358 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeTestJSON-1936456196-project Oct 17 04:35:39.104358 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:35:39.104358 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance bf59bfb1-79b1-4ebe-9635-380231dec617 could not be found. Oct 17 04:35:39.104358 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': 'bf59bfb1-79b1-4ebe-9635-380231dec617'} Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf59bfb1-79b1-4ebe-9635-380231dec617 could not be found. Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:35:39.105283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:35:39.107099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:35:39.107099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:35:39.107099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:35:39.107099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:35:39.107099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:35:39.107099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:35:39.107099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:35:39.107099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf59bfb1-79b1-4ebe-9635-380231dec617 could not be found. Oct 17 04:35:39.107099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:35:39.107099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:35:39.107099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:35:39.107099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:35:39.107099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:35:39.107099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:35:39.107099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:35:39.107099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:35:39.107099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf59bfb1-79b1-4ebe-9635-380231dec617 could not be found. Oct 17 04:35:39.107099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:35:39.108485 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc5c1cdb-f31a-4158-bc6a-9316b8e2ec5c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Returning 404 to user: Instance bf59bfb1-79b1-4ebe-9635-380231dec617 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:35:39.108485 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bc5c1cdb-f31a-4158-bc6a-9316b8e2ec5c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 404 len: 111 microversion: 2.1 time: 0.032078 Oct 17 04:35:39.108485 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 285/560] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:39 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:35:39.116027 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a28b40a-3775-4c5f-ba33-e622a250e2c9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '.version_select at 0x7fc630ee4dc0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:39.137878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2a28b40a-3775-4c5f-ba33-e622a250e2c9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771476207" status: 202 len: 0 microversion: 2.1 time: 0.026086 Oct 17 04:35:39.138479 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 276/561] 10.222.0.40 () {58 vars in 1221 bytes} [Mon Oct 17 04:35:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771476207 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:35:39.502669 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-82c25150-c52f-40f4-9b50-582bcb22937f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:39.503284 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-82c25150-c52f-40f4-9b50-582bcb22937f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 942796c5-f5b3-476a-ae21-dcaabf3bd8df] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:39.509544 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82c25150-c52f-40f4-9b50-582bcb22937f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:39.510012 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82c25150-c52f-40f4-9b50-582bcb22937f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:39.510468 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82c25150-c52f-40f4-9b50-582bcb22937f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:39.511157 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82c25150-c52f-40f4-9b50-582bcb22937f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:39.511634 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82c25150-c52f-40f4-9b50-582bcb22937f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:39.512854 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-82c25150-c52f-40f4-9b50-582bcb22937f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:39.526919 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-82c25150-c52f-40f4-9b50-582bcb22937f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] HTTP exception thrown: Instance 942796c5-f5b3-476a-ae21-dcaabf3bd8df could not be found. Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-82c25150-c52f-40f4-9b50-582bcb22937f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Request method failure captured: Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df HTTP/1.1 Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNqLhF-1OXgaOje4IGVnyezHko7_IZT00YPv9us17-37Q37nMNiHcC_lb8w7eKgJVeRiaXu6_GEjnJM1-HP1OhzVwjZNUQ6agiLoG5Dn6ckIJuDrH2TmKCF4QrHIDvZud13RDaxZYvs15jYkMJ96cW5VSzZewYAyctO5HLh7B5QnLlI Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: 7bd6234b23704bdf809481085ce465eb Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-438926643 Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:35:39.529673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:35:39.531289 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7bd6234b23704bdf809481085ce465eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7bd6234b23704bdf809481085ce465eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7bd6234b23704bdf809481085ce465eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7bd6234b23704bdf809481085ce465eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:35:39.531289 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-ServerRescueNegativeTestJSON-438926643 Oct 17 04:35:39.531289 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: 7bd6234b23704bdf809481085ce465eb Oct 17 04:35:39.531289 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-438926643 Oct 17 04:35:39.531289 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-ServerRescueNegativeTestJSON-438926643-project Oct 17 04:35:39.531289 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:35:39.531289 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:35:39.531289 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 308c01bc66224188aec055c2397a066b Oct 17 04:35:39.531289 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-ServerRescueNegativeTestJSON-438926643-project Oct 17 04:35:39.531289 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:35:39.531289 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance 942796c5-f5b3-476a-ae21-dcaabf3bd8df could not be found. Oct 17 04:35:39.531289 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': '942796c5-f5b3-476a-ae21-dcaabf3bd8df'} Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 942796c5-f5b3-476a-ae21-dcaabf3bd8df could not be found. Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:35:39.532100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:35:39.533516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:35:39.533516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:35:39.533516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:35:39.533516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:35:39.533516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:35:39.533516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:35:39.533516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:35:39.533516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 942796c5-f5b3-476a-ae21-dcaabf3bd8df could not be found. Oct 17 04:35:39.533516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:35:39.533516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:35:39.533516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:35:39.533516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:35:39.533516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:35:39.533516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:35:39.533516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:35:39.533516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:35:39.533516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 942796c5-f5b3-476a-ae21-dcaabf3bd8df could not be found. Oct 17 04:35:39.533516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:35:39.534729 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-82c25150-c52f-40f4-9b50-582bcb22937f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Returning 404 to user: Instance 942796c5-f5b3-476a-ae21-dcaabf3bd8df could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:35:39.534729 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-82c25150-c52f-40f4-9b50-582bcb22937f tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df" status: 404 len: 111 microversion: 2.1 time: 0.032284 Oct 17 04:35:39.534729 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 286/562] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:39 2022] GET /compute/v2.1/servers/942796c5-f5b3-476a-ae21-dcaabf3bd8df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:35:39.539894 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d01e9a39-d440-41dd-b77d-7c6c54ddede3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:39.540773 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d01e9a39-d440-41dd-b77d-7c6c54ddede3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:39.547920 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d01e9a39-d440-41dd-b77d-7c6c54ddede3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:39.548517 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d01e9a39-d440-41dd-b77d-7c6c54ddede3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:39.549065 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d01e9a39-d440-41dd-b77d-7c6c54ddede3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:39.549879 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d01e9a39-d440-41dd-b77d-7c6c54ddede3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:39.550427 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d01e9a39-d440-41dd-b77d-7c6c54ddede3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:39.550944 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d01e9a39-d440-41dd-b77d-7c6c54ddede3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:39.576219 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d01e9a39-d440-41dd-b77d-7c6c54ddede3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:35:39.650912 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d01e9a39-d440-41dd-b77d-7c6c54ddede3 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 204 len: 0 microversion: 2.1 time: 0.114552 Oct 17 04:35:39.651791 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 277/563] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:35:39 2022] DELETE /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:35:39.659913 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-77f7a984-3ed6-421b-bde7-ad98046e6501 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:39.660795 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-77f7a984-3ed6-421b-bde7-ad98046e6501 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:39.666871 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77f7a984-3ed6-421b-bde7-ad98046e6501 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:39.667352 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77f7a984-3ed6-421b-bde7-ad98046e6501 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:39.667782 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77f7a984-3ed6-421b-bde7-ad98046e6501 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:39.669231 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77f7a984-3ed6-421b-bde7-ad98046e6501 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:39.669494 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77f7a984-3ed6-421b-bde7-ad98046e6501 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:39.669943 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-77f7a984-3ed6-421b-bde7-ad98046e6501 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:39.828736 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1c15ec24-0a19-42e3-924c-1d6afd9d1c70 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Action: 'create', calling method: .version_select at 0x7fc630f22c10>, body: {"keypair": {"name": "tempest-keypair-1580109625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLR+LPvsYczQq80YMJADDnEXE364ozAYBUqT+kzQOZeyY2LWQ2wzDAgutb/d/8lggtI/HxKfvwXCa4t46JjOtCVCQjHneds51xz/O7raHo75eTkwIY4JbW9Eda9Ho5OMA=="}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:35:39.843799 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-1c15ec24-0a19-42e3-924c-1d6afd9d1c70 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Getting quotas for project 9de6141e0c3a41bcb84ac635b48a51df. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:35:39.847744 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-1c15ec24-0a19-42e3-924c-1d6afd9d1c70 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Getting quotas for user 78eac67939a44d0fa99cb748b56f7b70 and project 9de6141e0c3a41bcb84ac635b48a51df. Resources: {'key_pairs'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:35:39.849110 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-77f7a984-3ed6-421b-bde7-ad98046e6501 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:39.857368 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-77f7a984-3ed6-421b-bde7-ad98046e6501 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.201281 Oct 17 04:35:39.857932 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 287/564] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:39 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:39.882950 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1c15ec24-0a19-42e3-924c-1d6afd9d1c70 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059612 Oct 17 04:35:39.883539 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 278/565] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Oct 17 04:35:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:35:40.881475 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0cee5ebd-83e3-42da-abec-def94e64b060 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:40.882111 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0cee5ebd-83e3-42da-abec-def94e64b060 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:40.889100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0cee5ebd-83e3-42da-abec-def94e64b060 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:40.889612 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0cee5ebd-83e3-42da-abec-def94e64b060 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:40.890047 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0cee5ebd-83e3-42da-abec-def94e64b060 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:40.890742 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0cee5ebd-83e3-42da-abec-def94e64b060 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:40.891201 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0cee5ebd-83e3-42da-abec-def94e64b060 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:40.891627 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0cee5ebd-83e3-42da-abec-def94e64b060 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:41.028860 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-0cee5ebd-83e3-42da-abec-def94e64b060 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:41.037743 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0cee5ebd-83e3-42da-abec-def94e64b060 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.160203 Oct 17 04:35:41.038316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 288/566] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:40 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:41.135391 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-359916d6-e409-46bc-88a1-f85e92926f2c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1462484052", "imageRef": "bf655d8c-fb2f-42ef-a7a7-0386f57b58cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b651c35-159b-4d6e-a364-6761b8b7e75b"}], "security_groups": [{"name": "tempest-securitygroup--418535511"}], "key_name": "tempest-keypair-1580109625", "user_data": "}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:35:41.236951 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-359916d6-e409-46bc-88a1-f85e92926f2c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] validate_networks() for [('5b651c35-159b-4d6e-a364-6761b8b7e75b', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:35:41.823262 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-359916d6-e409-46bc-88a1-f85e92926f2c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:35:41.823691 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-359916d6-e409-46bc-88a1-f85e92926f2c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:35:41.824163 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-359916d6-e409-46bc-88a1-f85e92926f2c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:35:41.824886 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-359916d6-e409-46bc-88a1-f85e92926f2c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:35:41.825099 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-359916d6-e409-46bc-88a1-f85e92926f2c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:35:41.834045 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-359916d6-e409-46bc-88a1-f85e92926f2c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:41.834526 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-359916d6-e409-46bc-88a1-f85e92926f2c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:41.834969 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-359916d6-e409-46bc-88a1-f85e92926f2c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:41.835683 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-359916d6-e409-46bc-88a1-f85e92926f2c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:41.836141 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-359916d6-e409-46bc-88a1-f85e92926f2c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:41.836569 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-359916d6-e409-46bc-88a1-f85e92926f2c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:41.853415 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-359916d6-e409-46bc-88a1-f85e92926f2c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Getting quotas for project 9de6141e0c3a41bcb84ac635b48a51df. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:35:41.858132 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-359916d6-e409-46bc-88a1-f85e92926f2c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Getting quotas for user 78eac67939a44d0fa99cb748b56f7b70 and project 9de6141e0c3a41bcb84ac635b48a51df. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:35:41.868824 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-359916d6-e409-46bc-88a1-f85e92926f2c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:35:41.871319 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-359916d6-e409-46bc-88a1-f85e92926f2c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf655d8c-fb2f-42ef-a7a7-0386f57b58cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:35:41.917175 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-359916d6-e409-46bc-88a1-f85e92926f2c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.786393 Oct 17 04:35:41.918045 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 279/567] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:35:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 04:35:41.929304 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-965672a3-14b0-4f3b-b9df-b92f4d83fd8c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:41.929918 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-965672a3-14b0-4f3b-b9df-b92f4d83fd8c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:41.989698 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-965672a3-14b0-4f3b-b9df-b92f4d83fd8c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:41.996526 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-965672a3-14b0-4f3b-b9df-b92f4d83fd8c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 200 len: 1238 microversion: 2.1 time: 0.070798 Oct 17 04:35:41.997218 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 289/568] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:41 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:42.061116 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9888997a-9195-47e5-92ba-f7f2a1a9108b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:42.061728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9888997a-9195-47e5-92ba-f7f2a1a9108b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:42.067784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9888997a-9195-47e5-92ba-f7f2a1a9108b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:42.068267 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9888997a-9195-47e5-92ba-f7f2a1a9108b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:42.068706 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9888997a-9195-47e5-92ba-f7f2a1a9108b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:42.069423 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9888997a-9195-47e5-92ba-f7f2a1a9108b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:42.069878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9888997a-9195-47e5-92ba-f7f2a1a9108b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:42.070305 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9888997a-9195-47e5-92ba-f7f2a1a9108b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:42.207673 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-9888997a-9195-47e5-92ba-f7f2a1a9108b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:42.216903 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9888997a-9195-47e5-92ba-f7f2a1a9108b tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.159832 Oct 17 04:35:42.217656 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 280/569] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:42 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:43.019450 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b047871e-9063-43ab-83ed-861fa53d32a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:43.020089 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b047871e-9063-43ab-83ed-861fa53d32a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:43.027373 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b047871e-9063-43ab-83ed-861fa53d32a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:43.027773 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b047871e-9063-43ab-83ed-861fa53d32a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:43.028413 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b047871e-9063-43ab-83ed-861fa53d32a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:43.028889 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b047871e-9063-43ab-83ed-861fa53d32a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:43.030220 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b047871e-9063-43ab-83ed-861fa53d32a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:43.030664 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b047871e-9063-43ab-83ed-861fa53d32a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:43.095328 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b047871e-9063-43ab-83ed-861fa53d32a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:43.103947 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b047871e-9063-43ab-83ed-861fa53d32a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 200 len: 1290 microversion: 2.1 time: 0.088262 Oct 17 04:35:43.105337 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 290/570] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:43 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:43.239771 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1cb27536-ec3b-4ad1-b8c2-880da5fc9ce5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:43.240379 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1cb27536-ec3b-4ad1-b8c2-880da5fc9ce5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:43.246693 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1cb27536-ec3b-4ad1-b8c2-880da5fc9ce5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:43.247170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1cb27536-ec3b-4ad1-b8c2-880da5fc9ce5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:43.247601 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1cb27536-ec3b-4ad1-b8c2-880da5fc9ce5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:43.249441 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1cb27536-ec3b-4ad1-b8c2-880da5fc9ce5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:43.249900 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1cb27536-ec3b-4ad1-b8c2-880da5fc9ce5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:43.250321 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1cb27536-ec3b-4ad1-b8c2-880da5fc9ce5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:43.380698 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-1cb27536-ec3b-4ad1-b8c2-880da5fc9ce5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308c01bc66224188aec055c2397a066b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd6234b23704bdf809481085ce465eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:43.388445 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1cb27536-ec3b-4ad1-b8c2-880da5fc9ce5 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 200 len: 1522 microversion: 2.1 time: 0.152556 Oct 17 04:35:43.389594 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 281/571] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:43 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:43.522042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-37599c45-e15b-458b-949d-4b9abb27e311 req-03ee3b7d-fd88-450a-8c3a-33c42d8c9a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d8b2344-7541-41fa-b97f-734e7220308c", "name": "network-vif-deleted", "tag": "d527852d-57b4-4e00-893c-ff6f8df97d89"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:35:43.533827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-37599c45-e15b-458b-949d-4b9abb27e311 req-03ee3b7d-fd88-450a-8c3a-33c42d8c9a8b service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:43.534485 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-37599c45-e15b-458b-949d-4b9abb27e311 req-03ee3b7d-fd88-450a-8c3a-33c42d8c9a8b service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:43.535076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-37599c45-e15b-458b-949d-4b9abb27e311 req-03ee3b7d-fd88-450a-8c3a-33c42d8c9a8b service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:43.548071 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-37599c45-e15b-458b-949d-4b9abb27e311 req-03ee3b7d-fd88-450a-8c3a-33c42d8c9a8b service nova] Creating event network-vif-deleted:d527852d-57b4-4e00-893c-ff6f8df97d89 for instance 9d8b2344-7541-41fa-b97f-734e7220308c on hv-cinder-86155 Oct 17 04:35:43.553698 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-37599c45-e15b-458b-949d-4b9abb27e311 req-03ee3b7d-fd88-450a-8c3a-33c42d8c9a8b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037475 Oct 17 04:35:43.554351 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 291/572] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:35:44.127838 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-cdce5ed8-ed87-4273-b838-453c3479a732 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:44.128456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-cdce5ed8-ed87-4273-b838-453c3479a732 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:44.135262 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdce5ed8-ed87-4273-b838-453c3479a732 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:44.136031 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdce5ed8-ed87-4273-b838-453c3479a732 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:44.136607 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdce5ed8-ed87-4273-b838-453c3479a732 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:44.137393 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdce5ed8-ed87-4273-b838-453c3479a732 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:44.137848 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdce5ed8-ed87-4273-b838-453c3479a732 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:44.138300 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-cdce5ed8-ed87-4273-b838-453c3479a732 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:44.214649 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-cdce5ed8-ed87-4273-b838-453c3479a732 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:44.223729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-cdce5ed8-ed87-4273-b838-453c3479a732 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 200 len: 1296 microversion: 2.1 time: 0.099802 Oct 17 04:35:44.224321 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 282/573] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:44 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:44.414842 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f8a0f818-85bf-4740-bd38-c82d38e44bf1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:44.415544 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f8a0f818-85bf-4740-bd38-c82d38e44bf1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] [instance: 9d8b2344-7541-41fa-b97f-734e7220308c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:44.422424 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8a0f818-85bf-4740-bd38-c82d38e44bf1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:44.422910 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8a0f818-85bf-4740-bd38-c82d38e44bf1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:44.423349 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8a0f818-85bf-4740-bd38-c82d38e44bf1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:44.424049 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8a0f818-85bf-4740-bd38-c82d38e44bf1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:44.424512 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8a0f818-85bf-4740-bd38-c82d38e44bf1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:44.424938 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f8a0f818-85bf-4740-bd38-c82d38e44bf1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:44.438784 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-f8a0f818-85bf-4740-bd38-c82d38e44bf1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] HTTP exception thrown: Instance 9d8b2344-7541-41fa-b97f-734e7220308c could not be found. Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f8a0f818-85bf-4740-bd38-c82d38e44bf1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Request method failure captured: Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c HTTP/1.1 Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNqLhF-1OXgaOje4IGVnyezHko7_IZT00YPv9us17-37Q37nMNiHcC_lb8w7eKgJVeRiaXu6_GEjnJM1-HP1OhzVwjZNUQ6agiLoG5Dn6ckIJuDrH2TmKCF4QrHIDvZud13RDaxZYvs15jYkMJ96cW5VSzZewYAyctO5HLh7B5QnLlI Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: 7bd6234b23704bdf809481085ce465eb Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-438926643 Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:35:44.440401 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:35:44.441948 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7bd6234b23704bdf809481085ce465eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7bd6234b23704bdf809481085ce465eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7bd6234b23704bdf809481085ce465eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7bd6234b23704bdf809481085ce465eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:35:44.441948 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-ServerRescueNegativeTestJSON-438926643 Oct 17 04:35:44.441948 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: 7bd6234b23704bdf809481085ce465eb Oct 17 04:35:44.441948 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-438926643 Oct 17 04:35:44.441948 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-ServerRescueNegativeTestJSON-438926643-project Oct 17 04:35:44.441948 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:35:44.441948 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:35:44.441948 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 308c01bc66224188aec055c2397a066b Oct 17 04:35:44.441948 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-ServerRescueNegativeTestJSON-438926643-project Oct 17 04:35:44.441948 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:35:44.441948 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance 9d8b2344-7541-41fa-b97f-734e7220308c could not be found. Oct 17 04:35:44.441948 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': '9d8b2344-7541-41fa-b97f-734e7220308c'} Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d8b2344-7541-41fa-b97f-734e7220308c could not be found. Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:35:44.442692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:35:44.444076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:35:44.444076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:35:44.444076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:35:44.444076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:35:44.444076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:35:44.444076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:35:44.444076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:35:44.444076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d8b2344-7541-41fa-b97f-734e7220308c could not be found. Oct 17 04:35:44.444076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:35:44.444076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:35:44.444076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:35:44.444076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:35:44.444076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:35:44.444076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:35:44.444076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:35:44.444076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:35:44.444076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d8b2344-7541-41fa-b97f-734e7220308c could not be found. Oct 17 04:35:44.444076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:35:44.445378 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f8a0f818-85bf-4740-bd38-c82d38e44bf1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] Returning 404 to user: Instance 9d8b2344-7541-41fa-b97f-734e7220308c could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:35:44.445378 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f8a0f818-85bf-4740-bd38-c82d38e44bf1 tempest-ServerRescueNegativeTestJSON-438926643 tempest-ServerRescueNegativeTestJSON-438926643-project] 10.222.0.40 "GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c" status: 404 len: 111 microversion: 2.1 time: 0.031924 Oct 17 04:35:44.445378 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 292/574] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:44 2022] GET /compute/v2.1/servers/9d8b2344-7541-41fa-b97f-734e7220308c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:35:45.249683 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9ac718e6-a9cf-4ec5-897f-323eaecb9edb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:45.250504 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9ac718e6-a9cf-4ec5-897f-323eaecb9edb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:45.259688 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ac718e6-a9cf-4ec5-897f-323eaecb9edb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:45.260636 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ac718e6-a9cf-4ec5-897f-323eaecb9edb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:45.261468 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ac718e6-a9cf-4ec5-897f-323eaecb9edb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:45.262540 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ac718e6-a9cf-4ec5-897f-323eaecb9edb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:45.266122 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ac718e6-a9cf-4ec5-897f-323eaecb9edb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:45.266122 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9ac718e6-a9cf-4ec5-897f-323eaecb9edb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:45.486564 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-9ac718e6-a9cf-4ec5-897f-323eaecb9edb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:45.496973 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9ac718e6-a9cf-4ec5-897f-323eaecb9edb tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 200 len: 1363 microversion: 2.1 time: 0.252416 Oct 17 04:35:45.511559 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 283/575] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:45 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:45.581937 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-6f793d23-2857-498d-871a-335628be033d req-909b59e1-2b77-4c06-9355-5e82a89519da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fb709e6-ba7f-4703-8f7f-365c33a1c79c", "tag": "11b28132-99ac-43b2-87de-94474fddc936"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:35:45.591613 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6f793d23-2857-498d-871a-335628be033d req-909b59e1-2b77-4c06-9355-5e82a89519da service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:45.592288 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6f793d23-2857-498d-871a-335628be033d req-909b59e1-2b77-4c06-9355-5e82a89519da service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:45.593018 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-6f793d23-2857-498d-871a-335628be033d req-909b59e1-2b77-4c06-9355-5e82a89519da service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:45.605992 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-6f793d23-2857-498d-871a-335628be033d req-909b59e1-2b77-4c06-9355-5e82a89519da service nova] Creating event network-changed:11b28132-99ac-43b2-87de-94474fddc936 for instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c on hv-cinder-86155 Oct 17 04:35:45.611723 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-6f793d23-2857-498d-871a-335628be033d req-909b59e1-2b77-4c06-9355-5e82a89519da service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033355 Oct 17 04:35:45.612933 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 293/576] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:35:46.522695 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6b33cf1c-4789-41f4-8290-67d94316a0e7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:46.523237 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6b33cf1c-4789-41f4-8290-67d94316a0e7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:46.535277 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b33cf1c-4789-41f4-8290-67d94316a0e7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:46.535784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b33cf1c-4789-41f4-8290-67d94316a0e7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:46.536228 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b33cf1c-4789-41f4-8290-67d94316a0e7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:46.536951 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b33cf1c-4789-41f4-8290-67d94316a0e7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:46.537463 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b33cf1c-4789-41f4-8290-67d94316a0e7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:46.538071 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6b33cf1c-4789-41f4-8290-67d94316a0e7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:46.679075 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-6b33cf1c-4789-41f4-8290-67d94316a0e7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:46.687563 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6b33cf1c-4789-41f4-8290-67d94316a0e7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 200 len: 1363 microversion: 2.1 time: 0.168707 Oct 17 04:35:46.688223 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 284/577] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:46 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:47.711270 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ca1e10b8-e6cd-41ea-af0c-249020c321e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:47.711964 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ca1e10b8-e6cd-41ea-af0c-249020c321e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:47.718694 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca1e10b8-e6cd-41ea-af0c-249020c321e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:47.719250 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca1e10b8-e6cd-41ea-af0c-249020c321e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:47.719688 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca1e10b8-e6cd-41ea-af0c-249020c321e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:47.720372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca1e10b8-e6cd-41ea-af0c-249020c321e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:47.720826 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca1e10b8-e6cd-41ea-af0c-249020c321e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:47.721281 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ca1e10b8-e6cd-41ea-af0c-249020c321e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:47.861092 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-ca1e10b8-e6cd-41ea-af0c-249020c321e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:47.869056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ca1e10b8-e6cd-41ea-af0c-249020c321e9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 200 len: 1363 microversion: 2.1 time: 0.162509 Oct 17 04:35:47.869654 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 294/578] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:47 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:48.380161 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4f15c21a-1f0c-48e4-b7cd-73431fd22f02 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:48.381423 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4f15c21a-1f0c-48e4-b7cd-73431fd22f02 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:48.389633 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f15c21a-1f0c-48e4-b7cd-73431fd22f02 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:48.390475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f15c21a-1f0c-48e4-b7cd-73431fd22f02 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:48.391208 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f15c21a-1f0c-48e4-b7cd-73431fd22f02 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:48.392416 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f15c21a-1f0c-48e4-b7cd-73431fd22f02 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:48.392997 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f15c21a-1f0c-48e4-b7cd-73431fd22f02 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:48.393504 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4f15c21a-1f0c-48e4-b7cd-73431fd22f02 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:48.418384 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4f15c21a-1f0c-48e4-b7cd-73431fd22f02 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928/ips" status: 200 len: 150 microversion: 2.1 time: 0.043098 Oct 17 04:35:48.419001 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 285/579] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Oct 17 04:35:48 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:35:48.892674 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-06b25668-1252-4c33-9dfb-3954e0b52233 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:48.893329 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-06b25668-1252-4c33-9dfb-3954e0b52233 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:48.899892 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06b25668-1252-4c33-9dfb-3954e0b52233 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:48.900382 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06b25668-1252-4c33-9dfb-3954e0b52233 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:48.900871 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06b25668-1252-4c33-9dfb-3954e0b52233 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:48.901594 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06b25668-1252-4c33-9dfb-3954e0b52233 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:48.902054 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06b25668-1252-4c33-9dfb-3954e0b52233 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:48.902481 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06b25668-1252-4c33-9dfb-3954e0b52233 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:49.049297 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-06b25668-1252-4c33-9dfb-3954e0b52233 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:49.058327 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-06b25668-1252-4c33-9dfb-3954e0b52233 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 200 len: 1363 microversion: 2.1 time: 0.170086 Oct 17 04:35:49.058922 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 295/580] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:48 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:49.813545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5cc58461-09fc-4c34-ab2f-0ca002cd1b13 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70ce9adb-9184-48c4-8007-e63a8747b31a"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:35:49.815935 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5cc58461-09fc-4c34-ab2f-0ca002cd1b13 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:49.822599 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5cc58461-09fc-4c34-ab2f-0ca002cd1b13 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:49.823075 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5cc58461-09fc-4c34-ab2f-0ca002cd1b13 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:49.823504 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5cc58461-09fc-4c34-ab2f-0ca002cd1b13 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:49.824191 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5cc58461-09fc-4c34-ab2f-0ca002cd1b13 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:49.824639 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5cc58461-09fc-4c34-ab2f-0ca002cd1b13 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:49.825053 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5cc58461-09fc-4c34-ab2f-0ca002cd1b13 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:50.083392 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c109af11-a853-4414-add3-2cd9e0c0ea10 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:50.084200 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c109af11-a853-4414-add3-2cd9e0c0ea10 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:50.091201 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c109af11-a853-4414-add3-2cd9e0c0ea10 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:50.092283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c109af11-a853-4414-add3-2cd9e0c0ea10 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:50.092726 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c109af11-a853-4414-add3-2cd9e0c0ea10 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:50.093476 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5cc58461-09fc-4c34-ab2f-0ca002cd1b13 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "POST /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284620 Oct 17 04:35:50.093600 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c109af11-a853-4414-add3-2cd9e0c0ea10 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:50.094013 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c109af11-a853-4414-add3-2cd9e0c0ea10 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:50.094158 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 286/581] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Oct 17 04:35:49 2022] POST /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:35:50.094732 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c109af11-a853-4414-add3-2cd9e0c0ea10 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:50.239749 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c109af11-a853-4414-add3-2cd9e0c0ea10 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:50.247786 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c109af11-a853-4414-add3-2cd9e0c0ea10 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 200 len: 1363 microversion: 2.1 time: 0.169118 Oct 17 04:35:50.248344 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 296/582] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:50 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:50.668519 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-5fe65b85-a2d6-4e96-80b9-47d10bd5c5ce req-8851d68a-8a76-4063-a95c-2c02466aeaf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fb709e6-ba7f-4703-8f7f-365c33a1c79c", "name": "network-vif-plugged", "status": "completed", "tag": "11b28132-99ac-43b2-87de-94474fddc936"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:35:50.681406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5fe65b85-a2d6-4e96-80b9-47d10bd5c5ce req-8851d68a-8a76-4063-a95c-2c02466aeaf3 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:50.682266 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5fe65b85-a2d6-4e96-80b9-47d10bd5c5ce req-8851d68a-8a76-4063-a95c-2c02466aeaf3 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:50.682779 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5fe65b85-a2d6-4e96-80b9-47d10bd5c5ce req-8851d68a-8a76-4063-a95c-2c02466aeaf3 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:50.694573 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-5fe65b85-a2d6-4e96-80b9-47d10bd5c5ce req-8851d68a-8a76-4063-a95c-2c02466aeaf3 service nova] Creating event network-vif-plugged:11b28132-99ac-43b2-87de-94474fddc936 for instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c on hv-cinder-86155 Oct 17 04:35:50.699341 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-5fe65b85-a2d6-4e96-80b9-47d10bd5c5ce req-8851d68a-8a76-4063-a95c-2c02466aeaf3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035361 Oct 17 04:35:50.699959 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 287/583] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:35:51.271174 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c45d7f80-63d9-4fba-9db9-d7b27be7bd90 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:51.271797 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c45d7f80-63d9-4fba-9db9-d7b27be7bd90 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:51.279584 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c45d7f80-63d9-4fba-9db9-d7b27be7bd90 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:51.280149 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c45d7f80-63d9-4fba-9db9-d7b27be7bd90 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:51.280664 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c45d7f80-63d9-4fba-9db9-d7b27be7bd90 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:51.281460 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c45d7f80-63d9-4fba-9db9-d7b27be7bd90 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:51.282015 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c45d7f80-63d9-4fba-9db9-d7b27be7bd90 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:51.282512 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c45d7f80-63d9-4fba-9db9-d7b27be7bd90 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:51.416214 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c45d7f80-63d9-4fba-9db9-d7b27be7bd90 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:51.424576 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c45d7f80-63d9-4fba-9db9-d7b27be7bd90 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 200 len: 1363 microversion: 2.1 time: 0.157409 Oct 17 04:35:51.425169 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 297/584] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:51 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:52.445130 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:35:52.445998 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=10 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:35:52.450223 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b399499f-287b-485d-b364-a23d1b174f71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:52.451490 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b399499f-287b-485d-b364-a23d1b174f71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:52.458804 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b399499f-287b-485d-b364-a23d1b174f71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:52.459288 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b399499f-287b-485d-b364-a23d1b174f71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:52.459723 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b399499f-287b-485d-b364-a23d1b174f71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:52.460422 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b399499f-287b-485d-b364-a23d1b174f71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:52.460879 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b399499f-287b-485d-b364-a23d1b174f71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:52.461329 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b399499f-287b-485d-b364-a23d1b174f71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:52.604442 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-b399499f-287b-485d-b364-a23d1b174f71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:52.614929 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b399499f-287b-485d-b364-a23d1b174f71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 200 len: 1363 microversion: 2.1 time: 0.170904 Oct 17 04:35:52.615696 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 288/585] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:52 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:53.639185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-46f29718-57b5-44bc-a54a-bc734ff442a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:53.639796 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-46f29718-57b5-44bc-a54a-bc734ff442a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:53.641721 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:35:53.647364 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46f29718-57b5-44bc-a54a-bc734ff442a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:53.647829 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46f29718-57b5-44bc-a54a-bc734ff442a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:53.648260 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46f29718-57b5-44bc-a54a-bc734ff442a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:53.648941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46f29718-57b5-44bc-a54a-bc734ff442a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:53.649412 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46f29718-57b5-44bc-a54a-bc734ff442a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:53.649832 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-46f29718-57b5-44bc-a54a-bc734ff442a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:53.778352 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-46f29718-57b5-44bc-a54a-bc734ff442a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:53.786673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-46f29718-57b5-44bc-a54a-bc734ff442a3 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 200 len: 1549 microversion: 2.1 time: 0.151719 Oct 17 04:35:53.787246 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 298/586] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:53 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:53.810023 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0d8042d3-2cf0-4454-8d7c-0d7566b72bc8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:53.810780 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0d8042d3-2cf0-4454-8d7c-0d7566b72bc8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:53.817615 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d8042d3-2cf0-4454-8d7c-0d7566b72bc8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:53.818094 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d8042d3-2cf0-4454-8d7c-0d7566b72bc8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:53.818530 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d8042d3-2cf0-4454-8d7c-0d7566b72bc8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:53.819226 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d8042d3-2cf0-4454-8d7c-0d7566b72bc8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:53.819680 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d8042d3-2cf0-4454-8d7c-0d7566b72bc8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:53.820103 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0d8042d3-2cf0-4454-8d7c-0d7566b72bc8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:53.896157 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0d8042d3-2cf0-4454-8d7c-0d7566b72bc8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090711 Oct 17 04:35:53.896739 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 289/587] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Oct 17 04:35:53 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:35:55.070360 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-3c7dc9fc-6dbb-4a94-b403-153267e8626f req-140786b2-c1ea-4233-a12e-cfaa320695d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fb709e6-ba7f-4703-8f7f-365c33a1c79c", "tag": "11b28132-99ac-43b2-87de-94474fddc936"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:35:55.080761 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3c7dc9fc-6dbb-4a94-b403-153267e8626f req-140786b2-c1ea-4233-a12e-cfaa320695d5 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:55.081253 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3c7dc9fc-6dbb-4a94-b403-153267e8626f req-140786b2-c1ea-4233-a12e-cfaa320695d5 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:55.081675 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3c7dc9fc-6dbb-4a94-b403-153267e8626f req-140786b2-c1ea-4233-a12e-cfaa320695d5 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:55.092892 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-3c7dc9fc-6dbb-4a94-b403-153267e8626f req-140786b2-c1ea-4233-a12e-cfaa320695d5 service nova] Creating event network-changed:11b28132-99ac-43b2-87de-94474fddc936 for instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c on hv-cinder-86155 Oct 17 04:35:55.097817 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-3c7dc9fc-6dbb-4a94-b403-153267e8626f req-140786b2-c1ea-4233-a12e-cfaa320695d5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031108 Oct 17 04:35:55.098397 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 299/588] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:35:56.682339 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0309e310-1f56-4fcb-8952-43b4dccdc8eb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70ce9adb-9184-48c4-8007-e63a8747b31a"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:35:56.685064 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0309e310-1f56-4fcb-8952-43b4dccdc8eb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:56.704437 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0309e310-1f56-4fcb-8952-43b4dccdc8eb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:56.705187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0309e310-1f56-4fcb-8952-43b4dccdc8eb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:56.705824 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0309e310-1f56-4fcb-8952-43b4dccdc8eb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:56.706707 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0309e310-1f56-4fcb-8952-43b4dccdc8eb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:56.707172 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0309e310-1f56-4fcb-8952-43b4dccdc8eb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:56.707616 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0309e310-1f56-4fcb-8952-43b4dccdc8eb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:56.796188 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-0309e310-1f56-4fcb-8952-43b4dccdc8eb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] HTTP exception thrown: Invalid volume: volume 70ce9adb-9184-48c4-8007-e63a8747b31a is already attached to instances: 00d500c7-5fa9-4811-8064-25f3c15d0928 Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0309e310-1f56-4fcb-8952-43b4dccdc8eb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Request method failure captured: Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: POST /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928/os-volume_attachments HTTP/1.1 Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 74 Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNqRI5416bQSxgt6AXPotC0ZA8EQSE7l65zNcTm_mxUo9wFNmkuLDOKI-_C3Raae9FpamLQxUS44gziCftz35IAzDjSECza3w5spd_jxIdlfyyzXpOJTef9rLRzMW0mp2HVcK15b4ajr4hc5Lz_I9yQNIKfhl18_NwaTHORpu95fjDE Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:35:56.798406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:35:56.799982 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e022e6125e85417881ce226db7a5c764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e022e6125e85417881ce226db7a5c764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:35:56.799982 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:35:56.799982 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:35:56.799982 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:35:56.799982 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:35:56.799982 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:35:56.799982 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:35:56.799982 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: 59aa96241a8e4d9db6d255c38f618ca1 Oct 17 04:35:56.799982 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:35:56.799982 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Oct 17 04:35:56.799982 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {"volumeAttachment": {"volumeId": "70ce9adb-9184-48c4-8007-e63a8747b31a"}} Oct 17 04:35:56.799982 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:35:56.800802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Invalid volume: volume 70ce9adb-9184-48c4-8007-e63a8747b31a is already attached to instances: 00d500c7-5fa9-4811-8064-25f3c15d0928 Oct 17 04:35:56.800802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'server_id': '00d500c7-5fa9-4811-8064-25f3c15d0928', 'body': {'volumeAttachment': {'volumeId': '70ce9adb-9184-48c4-8007-e63a8747b31a'}}} Oct 17 04:35:56.800802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:35:56.800802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:35:56.800802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 04:35:56.800802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 04:35:56.800802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 04:35:56.800802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 04:35:56.800802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 04:35:56.800802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 04:35:56.800802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 04:35:56.800802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 04:35:56.800802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 04:35:56.800802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 04:35:56.800802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 70ce9adb-9184-48c4-8007-e63a8747b31a is already attached to instances: 00d500c7-5fa9-4811-8064-25f3c15d0928 Oct 17 04:35:56.800802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:35:56.800802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:35:56.800802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:35:56.800802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 70ce9adb-9184-48c4-8007-e63a8747b31a is already attached to instances: 00d500c7-5fa9-4811-8064-25f3c15d0928 Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:35:56.802462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:35:56.804022 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:35:56.804022 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:35:56.804022 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:35:56.804022 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 70ce9adb-9184-48c4-8007-e63a8747b31a is already attached to instances: 00d500c7-5fa9-4811-8064-25f3c15d0928 Oct 17 04:35:56.804022 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:35:56.804022 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0309e310-1f56-4fcb-8952-43b4dccdc8eb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Returning 400 to user: Invalid volume: volume 70ce9adb-9184-48c4-8007-e63a8747b31a is already attached to instances: 00d500c7-5fa9-4811-8064-25f3c15d0928 {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:35:56.804022 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0309e310-1f56-4fcb-8952-43b4dccdc8eb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "POST /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.124583 Oct 17 04:35:56.804022 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 290/589] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Oct 17 04:35:56 2022] POST /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928/os-volume_attachments => generated 174 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 04:35:56.867099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-63d2f7a9-f9c4-4982-bdca-dd5476534070 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:56.867806 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-63d2f7a9-f9c4-4982-bdca-dd5476534070 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:56.874440 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63d2f7a9-f9c4-4982-bdca-dd5476534070 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:56.875095 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63d2f7a9-f9c4-4982-bdca-dd5476534070 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:56.875876 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63d2f7a9-f9c4-4982-bdca-dd5476534070 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:56.876742 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63d2f7a9-f9c4-4982-bdca-dd5476534070 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:56.877232 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63d2f7a9-f9c4-4982-bdca-dd5476534070 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:56.877907 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-63d2f7a9-f9c4-4982-bdca-dd5476534070 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:56.962381 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-63d2f7a9-f9c4-4982-bdca-dd5476534070 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lazy-loading 'services' on Instance uuid 00d500c7-5fa9-4811-8064-25f3c15d0928 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:35:57.041154 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-63d2f7a9-f9c4-4982-bdca-dd5476534070 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "DELETE /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928/os-volume_attachments/70ce9adb-9184-48c4-8007-e63a8747b31a" status: 202 len: 0 microversion: 2.1 time: 0.178638 Oct 17 04:35:57.041899 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 300/590] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Oct 17 04:35:56 2022] DELETE /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928/os-volume_attachments/70ce9adb-9184-48c4-8007-e63a8747b31a => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:35:57.050892 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-90456ee2-06ff-49bb-8593-42b9101e3c52 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:57.053150 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-90456ee2-06ff-49bb-8593-42b9101e3c52 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:57.060865 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90456ee2-06ff-49bb-8593-42b9101e3c52 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:57.061803 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90456ee2-06ff-49bb-8593-42b9101e3c52 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:57.062402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90456ee2-06ff-49bb-8593-42b9101e3c52 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:57.063260 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90456ee2-06ff-49bb-8593-42b9101e3c52 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:57.063889 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90456ee2-06ff-49bb-8593-42b9101e3c52 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:57.064355 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90456ee2-06ff-49bb-8593-42b9101e3c52 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:57.099312 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:35:57.105327 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-90456ee2-06ff-49bb-8593-42b9101e3c52 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057925 Oct 17 04:35:57.106000 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 291/591] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:35:57 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:35:58.118854 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-62fa50d7-7182-487a-8d43-474c0b4bd85a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:58.121231 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-62fa50d7-7182-487a-8d43-474c0b4bd85a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:58.128701 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62fa50d7-7182-487a-8d43-474c0b4bd85a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:58.129215 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62fa50d7-7182-487a-8d43-474c0b4bd85a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:58.129650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62fa50d7-7182-487a-8d43-474c0b4bd85a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:58.130370 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62fa50d7-7182-487a-8d43-474c0b4bd85a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:58.130819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62fa50d7-7182-487a-8d43-474c0b4bd85a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:58.131237 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-62fa50d7-7182-487a-8d43-474c0b4bd85a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:58.152034 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:35:58.167567 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-62fa50d7-7182-487a-8d43-474c0b4bd85a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053539 Oct 17 04:35:58.168142 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 301/592] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:35:58 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 04:35:58.234357 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b4b8d9c3-3a8e-40e6-8914-5e0ecc55042d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:58.235152 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b4b8d9c3-3a8e-40e6-8914-5e0ecc55042d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:58.242517 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4b8d9c3-3a8e-40e6-8914-5e0ecc55042d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:58.243063 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4b8d9c3-3a8e-40e6-8914-5e0ecc55042d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:58.243619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4b8d9c3-3a8e-40e6-8914-5e0ecc55042d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:58.244314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4b8d9c3-3a8e-40e6-8914-5e0ecc55042d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:58.244798 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4b8d9c3-3a8e-40e6-8914-5e0ecc55042d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:58.245281 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b4b8d9c3-3a8e-40e6-8914-5e0ecc55042d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:58.272666 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b4b8d9c3-3a8e-40e6-8914-5e0ecc55042d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:35:58.353237 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b4b8d9c3-3a8e-40e6-8914-5e0ecc55042d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "DELETE /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928" status: 204 len: 0 microversion: 2.1 time: 0.123980 Oct 17 04:35:58.354143 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 292/593] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:35:58 2022] DELETE /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:35:58.363514 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c7531f5a-ef80-41ad-bbec-727a752b9087 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:58.364135 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c7531f5a-ef80-41ad-bbec-727a752b9087 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:58.371427 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7531f5a-ef80-41ad-bbec-727a752b9087 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:58.371913 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7531f5a-ef80-41ad-bbec-727a752b9087 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:58.372352 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7531f5a-ef80-41ad-bbec-727a752b9087 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:58.373097 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7531f5a-ef80-41ad-bbec-727a752b9087 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:58.373561 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7531f5a-ef80-41ad-bbec-727a752b9087 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:58.373987 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c7531f5a-ef80-41ad-bbec-727a752b9087 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:58.505014 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c7531f5a-ef80-41ad-bbec-727a752b9087 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:58.512882 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c7531f5a-ef80-41ad-bbec-727a752b9087 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928" status: 200 len: 1681 microversion: 2.1 time: 0.153729 Oct 17 04:35:58.514080 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 302/594] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:58 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:35:59.536591 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-da235d24-e3cb-401a-820e-8d264a54da08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:35:59.537335 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-da235d24-e3cb-401a-820e-8d264a54da08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:35:59.543701 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da235d24-e3cb-401a-820e-8d264a54da08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:59.544188 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da235d24-e3cb-401a-820e-8d264a54da08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:59.545452 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da235d24-e3cb-401a-820e-8d264a54da08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:59.546157 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da235d24-e3cb-401a-820e-8d264a54da08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:35:59.546607 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da235d24-e3cb-401a-820e-8d264a54da08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:35:59.547030 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-da235d24-e3cb-401a-820e-8d264a54da08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:35:59.735011 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-da235d24-e3cb-401a-820e-8d264a54da08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:35:59.743837 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-da235d24-e3cb-401a-820e-8d264a54da08 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928" status: 200 len: 1681 microversion: 2.1 time: 0.211753 Oct 17 04:35:59.744409 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 293/595] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:35:59 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:00.767428 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-851a59b6-df2b-495b-b147-7b173afc4315 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:00.768055 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-851a59b6-df2b-495b-b147-7b173afc4315 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:00.771589 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:36:00.775749 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-851a59b6-df2b-495b-b147-7b173afc4315 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:00.776243 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-851a59b6-df2b-495b-b147-7b173afc4315 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:00.776677 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-851a59b6-df2b-495b-b147-7b173afc4315 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:00.777676 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-851a59b6-df2b-495b-b147-7b173afc4315 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:00.778136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-851a59b6-df2b-495b-b147-7b173afc4315 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:00.778564 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-851a59b6-df2b-495b-b147-7b173afc4315 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:00.851876 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-851a59b6-df2b-495b-b147-7b173afc4315 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:00.861929 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-851a59b6-df2b-495b-b147-7b173afc4315 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928" status: 200 len: 1614 microversion: 2.1 time: 0.098685 Oct 17 04:36:00.862841 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 303/596] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:00 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 => generated 1614 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:01.087290 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-b7f5a65a-9973-4818-8d5f-ad5dbcb0176a req-47ae93e7-96be-4004-a2a6-7c8c574bc6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d500c7-5fa9-4811-8064-25f3c15d0928", "name": "network-vif-deleted", "tag": "b5d22a9b-0e70-4aa1-8839-2f3f94ffa514"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:36:01.099093 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b7f5a65a-9973-4818-8d5f-ad5dbcb0176a req-47ae93e7-96be-4004-a2a6-7c8c574bc6f9 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:01.099441 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b7f5a65a-9973-4818-8d5f-ad5dbcb0176a req-47ae93e7-96be-4004-a2a6-7c8c574bc6f9 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:01.100044 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-b7f5a65a-9973-4818-8d5f-ad5dbcb0176a req-47ae93e7-96be-4004-a2a6-7c8c574bc6f9 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:01.113529 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-b7f5a65a-9973-4818-8d5f-ad5dbcb0176a req-47ae93e7-96be-4004-a2a6-7c8c574bc6f9 service nova] Creating event network-vif-deleted:b5d22a9b-0e70-4aa1-8839-2f3f94ffa514 for instance 00d500c7-5fa9-4811-8064-25f3c15d0928 on hv-cinder-86155 Oct 17 04:36:01.119336 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-b7f5a65a-9973-4818-8d5f-ad5dbcb0176a req-47ae93e7-96be-4004-a2a6-7c8c574bc6f9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035738 Oct 17 04:36:01.125045 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 294/597] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:36:01.886594 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8d2f914e-1433-4fad-ad79-5c893a8b2d37 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:01.887807 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8d2f914e-1433-4fad-ad79-5c893a8b2d37 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:01.897927 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d2f914e-1433-4fad-ad79-5c893a8b2d37 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:01.898497 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d2f914e-1433-4fad-ad79-5c893a8b2d37 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:01.899201 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d2f914e-1433-4fad-ad79-5c893a8b2d37 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:01.900087 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d2f914e-1433-4fad-ad79-5c893a8b2d37 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:01.900815 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d2f914e-1433-4fad-ad79-5c893a8b2d37 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:01.901311 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8d2f914e-1433-4fad-ad79-5c893a8b2d37 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:01.919013 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-8d2f914e-1433-4fad-ad79-5c893a8b2d37 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] HTTP exception thrown: Instance 00d500c7-5fa9-4811-8064-25f3c15d0928 could not be found. Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8d2f914e-1433-4fad-ad79-5c893a8b2d37 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Request method failure captured: Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 HTTP/1.1 Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNqRI5416bQSxgt6AXPotC0ZA8EQSE7l65zNcTm_mxUo9wFNmkuLDOKI-_C3Raae9FpamLQxUS44gziCftz35IAzDjSECza3w5spd_jxIdlfyyzXpOJTef9rLRzMW0mp2HVcK15b4ajr4hc5Lz_I9yQNIKfhl18_NwaTHORpu95fjDE Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:36:01.921730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:36:01.923303 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e022e6125e85417881ce226db7a5c764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e022e6125e85417881ce226db7a5c764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:36:01.923303 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:36:01.923303 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:36:01.923303 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:36:01.923303 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:36:01.923303 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:36:01.923303 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:36:01.923303 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 59aa96241a8e4d9db6d255c38f618ca1 Oct 17 04:36:01.923303 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:36:01.923303 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:36:01.923303 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance 00d500c7-5fa9-4811-8064-25f3c15d0928 could not be found. Oct 17 04:36:01.923303 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': '00d500c7-5fa9-4811-8064-25f3c15d0928'} Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00d500c7-5fa9-4811-8064-25f3c15d0928 could not be found. Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:36:01.924185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:36:01.925716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:36:01.925716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:36:01.925716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:36:01.925716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:36:01.925716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:36:01.925716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:36:01.925716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:36:01.925716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00d500c7-5fa9-4811-8064-25f3c15d0928 could not be found. Oct 17 04:36:01.925716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:36:01.925716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:36:01.925716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:36:01.925716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:36:01.925716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:36:01.925716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:36:01.925716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:36:01.925716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:36:01.925716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00d500c7-5fa9-4811-8064-25f3c15d0928 could not be found. Oct 17 04:36:01.925716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:36:01.926769 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8d2f914e-1433-4fad-ad79-5c893a8b2d37 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Returning 404 to user: Instance 00d500c7-5fa9-4811-8064-25f3c15d0928 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:36:01.926769 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8d2f914e-1433-4fad-ad79-5c893a8b2d37 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928" status: 404 len: 111 microversion: 2.1 time: 0.041979 Oct 17 04:36:01.926769 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 304/598] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:01 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:36:01.933565 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a628b6e1-8ab2-433e-b3d5-9c92ee4c699f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '.version_select at 0x7fc630d6a820>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:01.960817 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a628b6e1-8ab2-433e-b3d5-9c92ee4c699f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-551201351" status: 202 len: 0 microversion: 2.1 time: 0.031594 Oct 17 04:36:01.961590 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 295/599] 10.222.0.40 () {58 vars in 1218 bytes} [Mon Oct 17 04:36:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-551201351 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:36:02.629184 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-08443f3c-42a7-4524-881c-dd2d5e6e274a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Action: 'create', calling method: .version_select at 0x7fc630ccd8b0>, body: {"keypair": {"name": "tempest-keypair-1806056836", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBWAV0wcdrcKmd2eovluz8dqtXEITL32vvZyaKyr2R5bDe16pPhO8TzDGQQCNeXTUAFDOVh3lV0814N7fVLWVd0hGD9lr5DHrLM+K6z/ZcFirL/FzlBDBM28lOrBQheZA=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:36:02.645652 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-08443f3c-42a7-4524-881c-dd2d5e6e274a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Getting quotas for project e022e6125e85417881ce226db7a5c764. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:36:02.650140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-08443f3c-42a7-4524-881c-dd2d5e6e274a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Getting quotas for user 59aa96241a8e4d9db6d255c38f618ca1 and project e022e6125e85417881ce226db7a5c764. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:36:02.673119 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-08443f3c-42a7-4524-881c-dd2d5e6e274a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047719 Oct 17 04:36:02.673728 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 305/600] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Oct 17 04:36:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:36:04.004387 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-131082f1-c631-459c-b82d-90651a7bd481 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-339244653", "imageRef": "bf655d8c-fb2f-42ef-a7a7-0386f57b58cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60b2c529-82f9-47ea-9951-24ba7b38ebc9"}], "security_groups": [{"name": "tempest-securitygroup--396579615"}], "key_name": "tempest-keypair-1806056836", "user_data": "}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:36:04.116111 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-131082f1-c631-459c-b82d-90651a7bd481 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] validate_networks() for [('60b2c529-82f9-47ea-9951-24ba7b38ebc9', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:36:04.486507 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-131082f1-c631-459c-b82d-90651a7bd481 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:36:04.486932 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-131082f1-c631-459c-b82d-90651a7bd481 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:36:04.487411 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-131082f1-c631-459c-b82d-90651a7bd481 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:36:04.487822 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-131082f1-c631-459c-b82d-90651a7bd481 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:36:04.488235 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-131082f1-c631-459c-b82d-90651a7bd481 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:36:04.496931 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-131082f1-c631-459c-b82d-90651a7bd481 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:04.498156 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-131082f1-c631-459c-b82d-90651a7bd481 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:04.498667 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-131082f1-c631-459c-b82d-90651a7bd481 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:04.499394 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-131082f1-c631-459c-b82d-90651a7bd481 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:04.499853 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-131082f1-c631-459c-b82d-90651a7bd481 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:04.500287 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-131082f1-c631-459c-b82d-90651a7bd481 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:04.516642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-131082f1-c631-459c-b82d-90651a7bd481 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Getting quotas for project e022e6125e85417881ce226db7a5c764. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:36:04.518836 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:36:04.521601 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-131082f1-c631-459c-b82d-90651a7bd481 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Getting quotas for user 59aa96241a8e4d9db6d255c38f618ca1 and project e022e6125e85417881ce226db7a5c764. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:36:04.535931 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-131082f1-c631-459c-b82d-90651a7bd481 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:36:04.538347 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-131082f1-c631-459c-b82d-90651a7bd481 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf655d8c-fb2f-42ef-a7a7-0386f57b58cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:36:04.589016 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-131082f1-c631-459c-b82d-90651a7bd481 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.589060 Oct 17 04:36:04.589728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 296/601] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:36:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 04:36:04.603177 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-89ac1010-ed03-4953-97e7-938116b6b58c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:04.603964 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-89ac1010-ed03-4953-97e7-938116b6b58c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:04.683300 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-89ac1010-ed03-4953-97e7-938116b6b58c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:04.690859 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-89ac1010-ed03-4953-97e7-938116b6b58c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 200 len: 1241 microversion: 2.1 time: 0.092476 Oct 17 04:36:04.691597 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 306/602] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:04 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:05.713773 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-13d27a5c-a5bc-4fd8-a7c2-bb96f4a739b7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:05.714323 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-13d27a5c-a5bc-4fd8-a7c2-bb96f4a739b7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:05.722540 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13d27a5c-a5bc-4fd8-a7c2-bb96f4a739b7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:05.723034 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13d27a5c-a5bc-4fd8-a7c2-bb96f4a739b7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:05.723475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13d27a5c-a5bc-4fd8-a7c2-bb96f4a739b7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:05.724366 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13d27a5c-a5bc-4fd8-a7c2-bb96f4a739b7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:05.724887 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13d27a5c-a5bc-4fd8-a7c2-bb96f4a739b7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:05.725768 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13d27a5c-a5bc-4fd8-a7c2-bb96f4a739b7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:05.795126 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-13d27a5c-a5bc-4fd8-a7c2-bb96f4a739b7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:05.804063 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-13d27a5c-a5bc-4fd8-a7c2-bb96f4a739b7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 200 len: 1301 microversion: 2.1 time: 0.094255 Oct 17 04:36:05.804715 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 297/603] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:05 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 1301 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:36:06.828724 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a58d6a7f-5579-4c73-9e61-71fe3d44b63e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:06.829469 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a58d6a7f-5579-4c73-9e61-71fe3d44b63e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:06.836089 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a58d6a7f-5579-4c73-9e61-71fe3d44b63e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:06.836670 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a58d6a7f-5579-4c73-9e61-71fe3d44b63e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:06.837132 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a58d6a7f-5579-4c73-9e61-71fe3d44b63e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:06.837836 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a58d6a7f-5579-4c73-9e61-71fe3d44b63e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:06.838286 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a58d6a7f-5579-4c73-9e61-71fe3d44b63e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:06.838707 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a58d6a7f-5579-4c73-9e61-71fe3d44b63e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:06.971350 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a58d6a7f-5579-4c73-9e61-71fe3d44b63e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:06.979872 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a58d6a7f-5579-4c73-9e61-71fe3d44b63e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 200 len: 1366 microversion: 2.1 time: 0.156087 Oct 17 04:36:06.980561 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 307/604] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:06 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:07.176144 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-63205ed1-d7cd-4732-a110-01c82cc0b2cc req-82023287-82c4-4ad3-839e-5c6914ce7930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cdbf4e7-ae88-4e26-a40b-cbd881612fe5", "tag": "1d5c5bce-a6c7-4bf9-a814-b29960fc6306"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:36:07.187567 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-63205ed1-d7cd-4732-a110-01c82cc0b2cc req-82023287-82c4-4ad3-839e-5c6914ce7930 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:07.188138 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-63205ed1-d7cd-4732-a110-01c82cc0b2cc req-82023287-82c4-4ad3-839e-5c6914ce7930 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:07.188640 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-63205ed1-d7cd-4732-a110-01c82cc0b2cc req-82023287-82c4-4ad3-839e-5c6914ce7930 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:07.201086 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-63205ed1-d7cd-4732-a110-01c82cc0b2cc req-82023287-82c4-4ad3-839e-5c6914ce7930 service nova] Creating event network-changed:1d5c5bce-a6c7-4bf9-a814-b29960fc6306 for instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 on hv-cinder-86155 Oct 17 04:36:07.206575 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-63205ed1-d7cd-4732-a110-01c82cc0b2cc req-82023287-82c4-4ad3-839e-5c6914ce7930 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034256 Oct 17 04:36:07.207168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 298/605] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:36:08.003314 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-02de3d76-c63e-4dd2-a29a-b87ccdfdac2e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:08.003947 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-02de3d76-c63e-4dd2-a29a-b87ccdfdac2e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:08.010311 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02de3d76-c63e-4dd2-a29a-b87ccdfdac2e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:08.010789 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02de3d76-c63e-4dd2-a29a-b87ccdfdac2e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:08.011283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02de3d76-c63e-4dd2-a29a-b87ccdfdac2e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:08.011963 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02de3d76-c63e-4dd2-a29a-b87ccdfdac2e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:08.012407 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02de3d76-c63e-4dd2-a29a-b87ccdfdac2e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:08.013474 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-02de3d76-c63e-4dd2-a29a-b87ccdfdac2e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:08.140828 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-02de3d76-c63e-4dd2-a29a-b87ccdfdac2e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:08.148533 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-02de3d76-c63e-4dd2-a29a-b87ccdfdac2e tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 200 len: 1366 microversion: 2.1 time: 0.149064 Oct 17 04:36:08.149114 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 308/606] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:07 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:09.171814 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a94c4804-bf89-4c1f-a404-95f3ac6a32d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:09.172500 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a94c4804-bf89-4c1f-a404-95f3ac6a32d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:09.178580 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a94c4804-bf89-4c1f-a404-95f3ac6a32d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:09.179042 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a94c4804-bf89-4c1f-a404-95f3ac6a32d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:09.179466 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a94c4804-bf89-4c1f-a404-95f3ac6a32d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:09.180148 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a94c4804-bf89-4c1f-a404-95f3ac6a32d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:09.180596 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a94c4804-bf89-4c1f-a404-95f3ac6a32d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:09.181011 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a94c4804-bf89-4c1f-a404-95f3ac6a32d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:09.313900 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-a94c4804-bf89-4c1f-a404-95f3ac6a32d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:09.321682 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a94c4804-bf89-4c1f-a404-95f3ac6a32d9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 200 len: 1366 microversion: 2.1 time: 0.154573 Oct 17 04:36:09.322251 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 299/607] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:09 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:10.345512 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5f3ca08a-741d-4c1d-a3a8-50ff7c5917dd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:10.346131 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5f3ca08a-741d-4c1d-a3a8-50ff7c5917dd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:10.352463 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f3ca08a-741d-4c1d-a3a8-50ff7c5917dd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:10.352943 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f3ca08a-741d-4c1d-a3a8-50ff7c5917dd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:10.353409 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f3ca08a-741d-4c1d-a3a8-50ff7c5917dd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:10.354096 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f3ca08a-741d-4c1d-a3a8-50ff7c5917dd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:10.354546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f3ca08a-741d-4c1d-a3a8-50ff7c5917dd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:10.354970 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f3ca08a-741d-4c1d-a3a8-50ff7c5917dd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:10.654254 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5f3ca08a-741d-4c1d-a3a8-50ff7c5917dd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:10.663731 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5f3ca08a-741d-4c1d-a3a8-50ff7c5917dd tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 200 len: 1366 microversion: 2.1 time: 0.322384 Oct 17 04:36:10.664334 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 309/608] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:10 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:11.687247 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c3da1af1-485f-4a65-a61f-0baab517fcba tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:11.687886 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c3da1af1-485f-4a65-a61f-0baab517fcba tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:11.694213 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3da1af1-485f-4a65-a61f-0baab517fcba tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:11.694693 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3da1af1-485f-4a65-a61f-0baab517fcba tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:11.695122 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3da1af1-485f-4a65-a61f-0baab517fcba tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:11.695804 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3da1af1-485f-4a65-a61f-0baab517fcba tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:11.696280 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3da1af1-485f-4a65-a61f-0baab517fcba tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:11.696701 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c3da1af1-485f-4a65-a61f-0baab517fcba tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:11.878529 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-c3da1af1-485f-4a65-a61f-0baab517fcba tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:11.886167 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c3da1af1-485f-4a65-a61f-0baab517fcba tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 200 len: 1366 microversion: 2.1 time: 0.202945 Oct 17 04:36:11.886720 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 300/609] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:11 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:12.766176 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-8b29b7de-9278-4c6b-abee-fae4bd152442 req-d564184d-e2a6-4574-b04a-91d1616046d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cdbf4e7-ae88-4e26-a40b-cbd881612fe5", "name": "network-vif-plugged", "status": "completed", "tag": "1d5c5bce-a6c7-4bf9-a814-b29960fc6306"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:36:12.776700 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8b29b7de-9278-4c6b-abee-fae4bd152442 req-d564184d-e2a6-4574-b04a-91d1616046d6 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:12.777220 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8b29b7de-9278-4c6b-abee-fae4bd152442 req-d564184d-e2a6-4574-b04a-91d1616046d6 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:12.777664 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-8b29b7de-9278-4c6b-abee-fae4bd152442 req-d564184d-e2a6-4574-b04a-91d1616046d6 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:12.791378 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-8b29b7de-9278-4c6b-abee-fae4bd152442 req-d564184d-e2a6-4574-b04a-91d1616046d6 service nova] Creating event network-vif-plugged:1d5c5bce-a6c7-4bf9-a814-b29960fc6306 for instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 on hv-cinder-86155 Oct 17 04:36:12.796750 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-8b29b7de-9278-4c6b-abee-fae4bd152442 req-d564184d-e2a6-4574-b04a-91d1616046d6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034842 Oct 17 04:36:12.797414 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 310/610] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:36:12.910591 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f8b77816-0318-49e3-afd9-680aa630c391 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:12.912719 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f8b77816-0318-49e3-afd9-680aa630c391 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:12.921405 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8b77816-0318-49e3-afd9-680aa630c391 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:12.922268 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8b77816-0318-49e3-afd9-680aa630c391 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:12.922941 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8b77816-0318-49e3-afd9-680aa630c391 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:12.923898 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8b77816-0318-49e3-afd9-680aa630c391 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:12.924739 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8b77816-0318-49e3-afd9-680aa630c391 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:12.925437 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f8b77816-0318-49e3-afd9-680aa630c391 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:13.066661 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f8b77816-0318-49e3-afd9-680aa630c391 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:13.075602 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f8b77816-0318-49e3-afd9-680aa630c391 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 200 len: 1366 microversion: 2.1 time: 0.170112 Oct 17 04:36:13.076174 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 301/611] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:12 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:14.100975 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-01f7be06-e60a-40ab-8568-498e4109837d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:14.101751 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-01f7be06-e60a-40ab-8568-498e4109837d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:14.108995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01f7be06-e60a-40ab-8568-498e4109837d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:14.109574 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01f7be06-e60a-40ab-8568-498e4109837d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:14.110096 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01f7be06-e60a-40ab-8568-498e4109837d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:14.110862 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01f7be06-e60a-40ab-8568-498e4109837d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:14.111323 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01f7be06-e60a-40ab-8568-498e4109837d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:14.111756 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01f7be06-e60a-40ab-8568-498e4109837d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:14.242685 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-01f7be06-e60a-40ab-8568-498e4109837d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:14.251276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-01f7be06-e60a-40ab-8568-498e4109837d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 200 len: 1366 microversion: 2.1 time: 0.155447 Oct 17 04:36:14.251854 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 311/612] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:14 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:15.275381 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:36:15.276124 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:36:15.329707 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dc0bc31b-f5dd-4c60-8d4f-f3618e53a056 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:15.330349 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dc0bc31b-f5dd-4c60-8d4f-f3618e53a056 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:15.336579 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc0bc31b-f5dd-4c60-8d4f-f3618e53a056 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:15.337056 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc0bc31b-f5dd-4c60-8d4f-f3618e53a056 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:15.337653 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc0bc31b-f5dd-4c60-8d4f-f3618e53a056 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:15.338267 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc0bc31b-f5dd-4c60-8d4f-f3618e53a056 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:15.338785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc0bc31b-f5dd-4c60-8d4f-f3618e53a056 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:15.339236 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dc0bc31b-f5dd-4c60-8d4f-f3618e53a056 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:15.472445 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-dc0bc31b-f5dd-4c60-8d4f-f3618e53a056 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:15.480201 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dc0bc31b-f5dd-4c60-8d4f-f3618e53a056 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 200 len: 1557 microversion: 2.1 time: 0.209911 Oct 17 04:36:15.480764 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 302/613] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:15 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 1557 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:15.503462 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5f7d0c3d-176d-443f-9543-2b227426f2d1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:15.503961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5f7d0c3d-176d-443f-9543-2b227426f2d1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:15.506097 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:36:15.511888 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f7d0c3d-176d-443f-9543-2b227426f2d1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:15.512360 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f7d0c3d-176d-443f-9543-2b227426f2d1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:15.512788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f7d0c3d-176d-443f-9543-2b227426f2d1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:15.513529 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f7d0c3d-176d-443f-9543-2b227426f2d1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:15.513975 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f7d0c3d-176d-443f-9543-2b227426f2d1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:15.514392 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f7d0c3d-176d-443f-9543-2b227426f2d1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:15.589104 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5f7d0c3d-176d-443f-9543-2b227426f2d1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090176 Oct 17 04:36:15.589692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 312/614] 10.222.0.40 () {58 vars in 1275 bytes} [Mon Oct 17 04:36:15 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:36:16.728274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9df1c7a0-3dfa-4884-b617-251ec7d1b981 req-c70d2f77-d6f1-4709-8063-0faa44d4e119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cdbf4e7-ae88-4e26-a40b-cbd881612fe5", "tag": "1d5c5bce-a6c7-4bf9-a814-b29960fc6306"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:36:16.738392 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9df1c7a0-3dfa-4884-b617-251ec7d1b981 req-c70d2f77-d6f1-4709-8063-0faa44d4e119 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:16.738866 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9df1c7a0-3dfa-4884-b617-251ec7d1b981 req-c70d2f77-d6f1-4709-8063-0faa44d4e119 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:16.739292 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9df1c7a0-3dfa-4884-b617-251ec7d1b981 req-c70d2f77-d6f1-4709-8063-0faa44d4e119 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:16.750574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9df1c7a0-3dfa-4884-b617-251ec7d1b981 req-c70d2f77-d6f1-4709-8063-0faa44d4e119 service nova] Creating event network-changed:1d5c5bce-a6c7-4bf9-a814-b29960fc6306 for instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 on hv-cinder-86155 Oct 17 04:36:16.755604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9df1c7a0-3dfa-4884-b617-251ec7d1b981 req-c70d2f77-d6f1-4709-8063-0faa44d4e119 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031000 Oct 17 04:36:16.756189 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 303/615] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:36:27.114716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:36:27.115513 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=46 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:36:27.279089 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-654dca8c-8826-4567-aff8-ee57037a77bd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:27.279614 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-654dca8c-8826-4567-aff8-ee57037a77bd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:27.286138 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-654dca8c-8826-4567-aff8-ee57037a77bd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:27.286613 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-654dca8c-8826-4567-aff8-ee57037a77bd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:27.287049 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-654dca8c-8826-4567-aff8-ee57037a77bd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:27.287724 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-654dca8c-8826-4567-aff8-ee57037a77bd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:27.288171 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-654dca8c-8826-4567-aff8-ee57037a77bd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:27.288589 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-654dca8c-8826-4567-aff8-ee57037a77bd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:27.311555 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-654dca8c-8826-4567-aff8-ee57037a77bd tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782/ips" status: 200 len: 151 microversion: 2.20 time: 0.198227 Oct 17 04:36:27.312104 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 313/616] 10.222.0.40 () {60 vars in 1289 bytes} [Mon Oct 17 04:36:27 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782/ips => generated 151 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 04:36:29.119431 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:36:29.120793 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:36:29.127141 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eb1544c6-eb2a-4eb5-a714-e51a57d360a6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:36:29.127257 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-eb1544c6-eb2a-4eb5-a714-e51a57d360a6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:29.135618 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eb1544c6-eb2a-4eb5-a714-e51a57d360a6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:29.136063 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eb1544c6-eb2a-4eb5-a714-e51a57d360a6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:29.137141 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eb1544c6-eb2a-4eb5-a714-e51a57d360a6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:29.138101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eb1544c6-eb2a-4eb5-a714-e51a57d360a6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:29.138858 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eb1544c6-eb2a-4eb5-a714-e51a57d360a6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:29.140024 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eb1544c6-eb2a-4eb5-a714-e51a57d360a6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:29.166079 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-eb1544c6-eb2a-4eb5-a714-e51a57d360a6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lazy-loading 'flavor' on Instance uuid e58170c9-886a-45c1-9c0e-acfb37fab782 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:36:29.387603 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-eb1544c6-eb2a-4eb5-a714-e51a57d360a6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "POST /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782/action" status: 202 len: 0 microversion: 2.20 time: 0.269444 Oct 17 04:36:29.388194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 304/617] 10.222.0.40 () {62 vars in 1319 bytes} [Mon Oct 17 04:36:29 2022] POST /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:36:29.397883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-51f85890-6e49-4693-9623-5ee26d64a860 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:29.399717 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-51f85890-6e49-4693-9623-5ee26d64a860 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:29.407132 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51f85890-6e49-4693-9623-5ee26d64a860 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:29.407811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51f85890-6e49-4693-9623-5ee26d64a860 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:29.408447 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51f85890-6e49-4693-9623-5ee26d64a860 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:29.409589 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51f85890-6e49-4693-9623-5ee26d64a860 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:29.410206 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51f85890-6e49-4693-9623-5ee26d64a860 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:29.410607 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-51f85890-6e49-4693-9623-5ee26d64a860 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:29.555244 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-51f85890-6e49-4693-9623-5ee26d64a860 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:29.565044 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-51f85890-6e49-4693-9623-5ee26d64a860 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:29.566959 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-51f85890-6e49-4693-9623-5ee26d64a860 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:29.568729 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-51f85890-6e49-4693-9623-5ee26d64a860 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.175717 Oct 17 04:36:29.570065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 314/618] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:29 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:30.597465 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-93d89223-ce6e-495a-a057-520b2ee3f7fe tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:30.598164 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-93d89223-ce6e-495a-a057-520b2ee3f7fe tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:30.604361 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93d89223-ce6e-495a-a057-520b2ee3f7fe tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:30.604839 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93d89223-ce6e-495a-a057-520b2ee3f7fe tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:30.605300 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93d89223-ce6e-495a-a057-520b2ee3f7fe tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:30.605993 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93d89223-ce6e-495a-a057-520b2ee3f7fe tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:30.606441 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93d89223-ce6e-495a-a057-520b2ee3f7fe tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:30.606868 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-93d89223-ce6e-495a-a057-520b2ee3f7fe tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:30.745013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-93d89223-ce6e-495a-a057-520b2ee3f7fe tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:30.754016 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-93d89223-ce6e-495a-a057-520b2ee3f7fe tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:30.755480 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-93d89223-ce6e-495a-a057-520b2ee3f7fe tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:30.756650 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-93d89223-ce6e-495a-a057-520b2ee3f7fe tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.164538 Oct 17 04:36:30.757219 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 305/619] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:30 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:31.781755 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c8afe459-0b89-4291-b5ed-08e8039f35ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:31.782368 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c8afe459-0b89-4291-b5ed-08e8039f35ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:31.788487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8afe459-0b89-4291-b5ed-08e8039f35ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:31.788966 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8afe459-0b89-4291-b5ed-08e8039f35ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:31.789427 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8afe459-0b89-4291-b5ed-08e8039f35ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:31.790108 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8afe459-0b89-4291-b5ed-08e8039f35ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:31.790579 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8afe459-0b89-4291-b5ed-08e8039f35ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:31.790995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c8afe459-0b89-4291-b5ed-08e8039f35ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:31.813925 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-76eeb61f-2b27-4988-920c-e45c09e7ed81 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:36:31.814451 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-76eeb61f-2b27-4988-920c-e45c09e7ed81 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:31.820787 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76eeb61f-2b27-4988-920c-e45c09e7ed81 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:31.821308 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76eeb61f-2b27-4988-920c-e45c09e7ed81 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:31.821743 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76eeb61f-2b27-4988-920c-e45c09e7ed81 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:31.822429 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76eeb61f-2b27-4988-920c-e45c09e7ed81 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:31.822877 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76eeb61f-2b27-4988-920c-e45c09e7ed81 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:31.823298 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-76eeb61f-2b27-4988-920c-e45c09e7ed81 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:31.847526 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-76eeb61f-2b27-4988-920c-e45c09e7ed81 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lazy-loading 'flavor' on Instance uuid c04fcc98-6f6b-4092-ba63-364498327bb6 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:36:31.920263 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c8afe459-0b89-4291-b5ed-08e8039f35ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:31.920496 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-76eeb61f-2b27-4988-920c-e45c09e7ed81 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "POST /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6/action" status: 202 len: 0 microversion: 2.1 time: 0.110496 Oct 17 04:36:31.921127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 306/620] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Oct 17 04:36:31 2022] POST /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 04:36:31.929410 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c8afe459-0b89-4291-b5ed-08e8039f35ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:31.929760 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2cffc92e-f34b-4df9-af76-7c5aa94b3e95 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:31.930486 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2cffc92e-f34b-4df9-af76-7c5aa94b3e95 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:31.931531 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c8afe459-0b89-4291-b5ed-08e8039f35ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:31.932730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c8afe459-0b89-4291-b5ed-08e8039f35ae tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.155631 Oct 17 04:36:31.933477 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 315/621] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:31 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:31.944456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2cffc92e-f34b-4df9-af76-7c5aa94b3e95 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:31.945043 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2cffc92e-f34b-4df9-af76-7c5aa94b3e95 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:31.945505 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2cffc92e-f34b-4df9-af76-7c5aa94b3e95 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:31.946204 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2cffc92e-f34b-4df9-af76-7c5aa94b3e95 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:31.946659 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2cffc92e-f34b-4df9-af76-7c5aa94b3e95 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:31.947082 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2cffc92e-f34b-4df9-af76-7c5aa94b3e95 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:32.086427 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-2cffc92e-f34b-4df9-af76-7c5aa94b3e95 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:32.094814 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2cffc92e-f34b-4df9-af76-7c5aa94b3e95 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1567 microversion: 2.1 time: 0.169187 Oct 17 04:36:32.095389 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 307/622] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:31 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:32.959436 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7c87155a-444c-4e2d-8d79-2ad5d6fd69e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:32.960097 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7c87155a-444c-4e2d-8d79-2ad5d6fd69e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:32.966393 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c87155a-444c-4e2d-8d79-2ad5d6fd69e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:32.966874 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c87155a-444c-4e2d-8d79-2ad5d6fd69e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:32.967843 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c87155a-444c-4e2d-8d79-2ad5d6fd69e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:32.968535 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c87155a-444c-4e2d-8d79-2ad5d6fd69e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:32.968983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c87155a-444c-4e2d-8d79-2ad5d6fd69e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:32.969609 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7c87155a-444c-4e2d-8d79-2ad5d6fd69e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:33.101698 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-7c87155a-444c-4e2d-8d79-2ad5d6fd69e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:33.111028 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-7c87155a-444c-4e2d-8d79-2ad5d6fd69e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:33.112511 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-7c87155a-444c-4e2d-8d79-2ad5d6fd69e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:33.114069 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7c87155a-444c-4e2d-8d79-2ad5d6fd69e6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.159317 Oct 17 04:36:33.114790 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 316/623] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:32 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:33.118152 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a91787d8-e76f-410e-b848-a73ad8075bda tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:33.119102 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a91787d8-e76f-410e-b848-a73ad8075bda tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:33.136877 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a91787d8-e76f-410e-b848-a73ad8075bda tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:33.137504 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a91787d8-e76f-410e-b848-a73ad8075bda tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:33.138107 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a91787d8-e76f-410e-b848-a73ad8075bda tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:33.138844 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a91787d8-e76f-410e-b848-a73ad8075bda tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:33.139425 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a91787d8-e76f-410e-b848-a73ad8075bda tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:33.139941 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a91787d8-e76f-410e-b848-a73ad8075bda tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:33.277790 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-a91787d8-e76f-410e-b848-a73ad8075bda tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:33.286343 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a91787d8-e76f-410e-b848-a73ad8075bda tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1567 microversion: 2.1 time: 0.172142 Oct 17 04:36:33.286925 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 308/624] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:33 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:34.142035 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-972af94d-d662-47af-99f8-8d81e4ac5d0d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:34.142674 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-972af94d-d662-47af-99f8-8d81e4ac5d0d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:34.149032 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-972af94d-d662-47af-99f8-8d81e4ac5d0d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:34.149547 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-972af94d-d662-47af-99f8-8d81e4ac5d0d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:34.149984 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-972af94d-d662-47af-99f8-8d81e4ac5d0d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:34.150677 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-972af94d-d662-47af-99f8-8d81e4ac5d0d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:34.151132 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-972af94d-d662-47af-99f8-8d81e4ac5d0d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:34.151558 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-972af94d-d662-47af-99f8-8d81e4ac5d0d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:34.279610 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-972af94d-d662-47af-99f8-8d81e4ac5d0d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:34.287655 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-972af94d-d662-47af-99f8-8d81e4ac5d0d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:34.289138 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-972af94d-d662-47af-99f8-8d81e4ac5d0d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:34.290297 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-972af94d-d662-47af-99f8-8d81e4ac5d0d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.152188 Oct 17 04:36:34.290858 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 317/625] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:34 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:34.310159 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-49743ab8-446e-4a44-aa81-adcfcfba0cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:34.310767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-49743ab8-446e-4a44-aa81-adcfcfba0cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:34.317721 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49743ab8-446e-4a44-aa81-adcfcfba0cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:34.318209 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49743ab8-446e-4a44-aa81-adcfcfba0cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:34.318647 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49743ab8-446e-4a44-aa81-adcfcfba0cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:34.319342 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49743ab8-446e-4a44-aa81-adcfcfba0cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:34.319794 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49743ab8-446e-4a44-aa81-adcfcfba0cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:34.320237 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-49743ab8-446e-4a44-aa81-adcfcfba0cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:34.447511 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-49743ab8-446e-4a44-aa81-adcfcfba0cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:34.455761 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-49743ab8-446e-4a44-aa81-adcfcfba0cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1567 microversion: 2.1 time: 0.149391 Oct 17 04:36:34.456329 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 309/626] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:34 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:35.316029 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b5bf2c5b-d04c-4023-9fed-4a0912827417 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:35.316636 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b5bf2c5b-d04c-4023-9fed-4a0912827417 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:35.323035 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5bf2c5b-d04c-4023-9fed-4a0912827417 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:35.323508 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5bf2c5b-d04c-4023-9fed-4a0912827417 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:35.323937 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5bf2c5b-d04c-4023-9fed-4a0912827417 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:35.324615 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5bf2c5b-d04c-4023-9fed-4a0912827417 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:35.325067 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5bf2c5b-d04c-4023-9fed-4a0912827417 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:35.325511 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5bf2c5b-d04c-4023-9fed-4a0912827417 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:35.459819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b5bf2c5b-d04c-4023-9fed-4a0912827417 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:35.467911 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b5bf2c5b-d04c-4023-9fed-4a0912827417 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:35.469399 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b5bf2c5b-d04c-4023-9fed-4a0912827417 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:35.470556 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b5bf2c5b-d04c-4023-9fed-4a0912827417 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.158994 Oct 17 04:36:35.471119 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 318/627] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:35 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:35.479361 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1d6e66b7-a514-4c56-a27d-a5fe73ec5b48 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:35.479971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1d6e66b7-a514-4c56-a27d-a5fe73ec5b48 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:35.486325 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d6e66b7-a514-4c56-a27d-a5fe73ec5b48 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:35.486817 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d6e66b7-a514-4c56-a27d-a5fe73ec5b48 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:35.487258 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d6e66b7-a514-4c56-a27d-a5fe73ec5b48 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:35.487952 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d6e66b7-a514-4c56-a27d-a5fe73ec5b48 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:35.488410 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d6e66b7-a514-4c56-a27d-a5fe73ec5b48 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:35.488839 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1d6e66b7-a514-4c56-a27d-a5fe73ec5b48 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:35.618675 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-1d6e66b7-a514-4c56-a27d-a5fe73ec5b48 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:35.626568 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1d6e66b7-a514-4c56-a27d-a5fe73ec5b48 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1567 microversion: 2.1 time: 0.151026 Oct 17 04:36:35.627147 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 310/628] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:35 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:36.496442 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-75330cd7-e584-49b5-9a54-e3d0ee3b0bec tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:36.497136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-75330cd7-e584-49b5-9a54-e3d0ee3b0bec tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:36.504299 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75330cd7-e584-49b5-9a54-e3d0ee3b0bec tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:36.504807 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75330cd7-e584-49b5-9a54-e3d0ee3b0bec tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:36.505252 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75330cd7-e584-49b5-9a54-e3d0ee3b0bec tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:36.505967 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75330cd7-e584-49b5-9a54-e3d0ee3b0bec tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:36.506373 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75330cd7-e584-49b5-9a54-e3d0ee3b0bec tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:36.507541 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-75330cd7-e584-49b5-9a54-e3d0ee3b0bec tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:36.639032 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-75330cd7-e584-49b5-9a54-e3d0ee3b0bec tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:36.648082 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-75330cd7-e584-49b5-9a54-e3d0ee3b0bec tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:36.649548 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-75330cd7-e584-49b5-9a54-e3d0ee3b0bec tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:36.650159 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-792b88ea-3510-4250-a577-669bf8e16195 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:36.650700 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-75330cd7-e584-49b5-9a54-e3d0ee3b0bec tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.158595 Oct 17 04:36:36.650826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-792b88ea-3510-4250-a577-669bf8e16195 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:36.651259 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 319/629] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:36 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:36.657847 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-792b88ea-3510-4250-a577-669bf8e16195 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:36.658320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-792b88ea-3510-4250-a577-669bf8e16195 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:36.658756 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-792b88ea-3510-4250-a577-669bf8e16195 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:36.659440 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-792b88ea-3510-4250-a577-669bf8e16195 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:36.659887 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-792b88ea-3510-4250-a577-669bf8e16195 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:36.660308 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-792b88ea-3510-4250-a577-669bf8e16195 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:36.787428 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-792b88ea-3510-4250-a577-669bf8e16195 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:36.795076 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-792b88ea-3510-4250-a577-669bf8e16195 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1567 microversion: 2.1 time: 0.148704 Oct 17 04:36:36.795644 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 311/630] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:36 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:36:37.676161 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b993f241-9266-448c-afa3-d4e5da0cf401 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:37.676690 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b993f241-9266-448c-afa3-d4e5da0cf401 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:37.683246 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b993f241-9266-448c-afa3-d4e5da0cf401 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:37.683727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b993f241-9266-448c-afa3-d4e5da0cf401 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:37.684154 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b993f241-9266-448c-afa3-d4e5da0cf401 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:37.684843 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b993f241-9266-448c-afa3-d4e5da0cf401 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:37.685323 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b993f241-9266-448c-afa3-d4e5da0cf401 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:37.685741 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b993f241-9266-448c-afa3-d4e5da0cf401 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:37.818963 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-98c464f0-5c7e-439e-af3a-cdf20ac7444b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:37.819568 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-98c464f0-5c7e-439e-af3a-cdf20ac7444b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:37.826361 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98c464f0-5c7e-439e-af3a-cdf20ac7444b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:37.826854 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98c464f0-5c7e-439e-af3a-cdf20ac7444b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:37.828379 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98c464f0-5c7e-439e-af3a-cdf20ac7444b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:37.829327 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98c464f0-5c7e-439e-af3a-cdf20ac7444b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:37.829793 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98c464f0-5c7e-439e-af3a-cdf20ac7444b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:37.830226 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-98c464f0-5c7e-439e-af3a-cdf20ac7444b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:37.844521 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b993f241-9266-448c-afa3-d4e5da0cf401 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:37.853064 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b993f241-9266-448c-afa3-d4e5da0cf401 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:37.854656 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b993f241-9266-448c-afa3-d4e5da0cf401 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:37.855917 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b993f241-9266-448c-afa3-d4e5da0cf401 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.183676 Oct 17 04:36:37.856614 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 320/631] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:37 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:37.973539 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-98c464f0-5c7e-439e-af3a-cdf20ac7444b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:37.981754 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-98c464f0-5c7e-439e-af3a-cdf20ac7444b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1567 microversion: 2.1 time: 0.166786 Oct 17 04:36:37.982331 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 312/632] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:37 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:36:38.826721 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-61f249bc-2cc3-4e2a-b3d6-a254ecbb3167 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:38.827285 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-61f249bc-2cc3-4e2a-b3d6-a254ecbb3167 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:38.834010 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61f249bc-2cc3-4e2a-b3d6-a254ecbb3167 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:38.834494 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61f249bc-2cc3-4e2a-b3d6-a254ecbb3167 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:38.834930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61f249bc-2cc3-4e2a-b3d6-a254ecbb3167 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:38.835622 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61f249bc-2cc3-4e2a-b3d6-a254ecbb3167 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:38.836078 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61f249bc-2cc3-4e2a-b3d6-a254ecbb3167 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:38.836527 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-61f249bc-2cc3-4e2a-b3d6-a254ecbb3167 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:38.860823 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-61f249bc-2cc3-4e2a-b3d6-a254ecbb3167 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/ips" status: 200 len: 145 microversion: 2.1 time: 0.207959 Oct 17 04:36:38.861424 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 321/633] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Oct 17 04:36:38 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/ips => generated 145 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:36:38.887302 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a7a6ae1-eae1-4847-ad6c-33e72d34f312 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:38.887302 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2a7a6ae1-eae1-4847-ad6c-33e72d34f312 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:38.894184 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a7a6ae1-eae1-4847-ad6c-33e72d34f312 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:38.894843 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a7a6ae1-eae1-4847-ad6c-33e72d34f312 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:38.895657 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a7a6ae1-eae1-4847-ad6c-33e72d34f312 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:38.896631 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a7a6ae1-eae1-4847-ad6c-33e72d34f312 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:38.897163 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a7a6ae1-eae1-4847-ad6c-33e72d34f312 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:38.897695 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a7a6ae1-eae1-4847-ad6c-33e72d34f312 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:39.007882 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e7cc632e-a834-4836-b338-69f7f19f76c6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:39.008760 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e7cc632e-a834-4836-b338-69f7f19f76c6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:39.015540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7cc632e-a834-4836-b338-69f7f19f76c6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:39.016072 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7cc632e-a834-4836-b338-69f7f19f76c6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:39.016548 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7cc632e-a834-4836-b338-69f7f19f76c6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:39.017486 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7cc632e-a834-4836-b338-69f7f19f76c6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:39.018222 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7cc632e-a834-4836-b338-69f7f19f76c6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:39.018864 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7cc632e-a834-4836-b338-69f7f19f76c6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:39.056191 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-2a7a6ae1-eae1-4847-ad6c-33e72d34f312 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:39.068520 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-2a7a6ae1-eae1-4847-ad6c-33e72d34f312 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:39.070345 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-2a7a6ae1-eae1-4847-ad6c-33e72d34f312 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:39.071502 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2a7a6ae1-eae1-4847-ad6c-33e72d34f312 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.190512 Oct 17 04:36:39.072167 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 313/634] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:38 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:39.214842 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e7cc632e-a834-4836-b338-69f7f19f76c6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:39.224295 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e7cc632e-a834-4836-b338-69f7f19f76c6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1567 microversion: 2.1 time: 0.220966 Oct 17 04:36:39.237854 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 322/635] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:39 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:36:40.097861 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dcfae020-8166-49b0-bcfd-852fe8af8f42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:40.098578 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dcfae020-8166-49b0-bcfd-852fe8af8f42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:40.104901 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcfae020-8166-49b0-bcfd-852fe8af8f42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:40.105417 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcfae020-8166-49b0-bcfd-852fe8af8f42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:40.105845 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcfae020-8166-49b0-bcfd-852fe8af8f42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:40.106525 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcfae020-8166-49b0-bcfd-852fe8af8f42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:40.106971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcfae020-8166-49b0-bcfd-852fe8af8f42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:40.107388 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dcfae020-8166-49b0-bcfd-852fe8af8f42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:40.252712 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-dcfae020-8166-49b0-bcfd-852fe8af8f42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:40.255347 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b01d63a3-e7e4-48bf-a3aa-f4b739666ee2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:40.255969 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b01d63a3-e7e4-48bf-a3aa-f4b739666ee2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:40.268207 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-dcfae020-8166-49b0-bcfd-852fe8af8f42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:40.269599 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-dcfae020-8166-49b0-bcfd-852fe8af8f42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:40.270780 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dcfae020-8166-49b0-bcfd-852fe8af8f42 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.177834 Oct 17 04:36:40.273144 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b01d63a3-e7e4-48bf-a3aa-f4b739666ee2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:40.273635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b01d63a3-e7e4-48bf-a3aa-f4b739666ee2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:40.274068 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b01d63a3-e7e4-48bf-a3aa-f4b739666ee2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:40.274920 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b01d63a3-e7e4-48bf-a3aa-f4b739666ee2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:40.275378 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b01d63a3-e7e4-48bf-a3aa-f4b739666ee2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:40.275800 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b01d63a3-e7e4-48bf-a3aa-f4b739666ee2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:40.280141 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 314/636] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:40 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:40.338416 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d1296eb6-8074-4b4b-a657-e63dfe380192 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40fbe1a4-9944-44ba-a524-b1b02703569a"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:36:40.341014 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d1296eb6-8074-4b4b-a657-e63dfe380192 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:40.347640 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1296eb6-8074-4b4b-a657-e63dfe380192 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:40.348135 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1296eb6-8074-4b4b-a657-e63dfe380192 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:40.348598 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1296eb6-8074-4b4b-a657-e63dfe380192 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:40.349348 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1296eb6-8074-4b4b-a657-e63dfe380192 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:40.349760 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1296eb6-8074-4b4b-a657-e63dfe380192 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:40.350183 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d1296eb6-8074-4b4b-a657-e63dfe380192 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:40.423673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b01d63a3-e7e4-48bf-a3aa-f4b739666ee2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:40.431788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b01d63a3-e7e4-48bf-a3aa-f4b739666ee2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1567 microversion: 2.1 time: 0.186637 Oct 17 04:36:40.432373 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 323/637] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:40 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:40.587487 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:36:40.611638 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d1296eb6-8074-4b4b-a657-e63dfe380192 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "POST /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277188 Oct 17 04:36:40.612245 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 315/638] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Oct 17 04:36:40 2022] POST /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:36:41.302266 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1cd73d18-23a6-4921-b788-f2b4e288eb58 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:41.302801 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1cd73d18-23a6-4921-b788-f2b4e288eb58 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:41.309176 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cd73d18-23a6-4921-b788-f2b4e288eb58 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:41.309648 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cd73d18-23a6-4921-b788-f2b4e288eb58 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:41.310083 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cd73d18-23a6-4921-b788-f2b4e288eb58 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:41.310772 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cd73d18-23a6-4921-b788-f2b4e288eb58 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:41.311226 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cd73d18-23a6-4921-b788-f2b4e288eb58 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:41.311650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1cd73d18-23a6-4921-b788-f2b4e288eb58 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:41.444087 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-1cd73d18-23a6-4921-b788-f2b4e288eb58 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:41.452242 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-1cd73d18-23a6-4921-b788-f2b4e288eb58 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:41.454071 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-1cd73d18-23a6-4921-b788-f2b4e288eb58 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:41.455237 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1cd73d18-23a6-4921-b788-f2b4e288eb58 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.159017 Oct 17 04:36:41.455796 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 324/639] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:41 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:41.457243 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c4f82d23-47ef-462a-b8d1-580ca0712f5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:41.458034 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c4f82d23-47ef-462a-b8d1-580ca0712f5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:41.465565 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4f82d23-47ef-462a-b8d1-580ca0712f5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:41.466056 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4f82d23-47ef-462a-b8d1-580ca0712f5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:41.466624 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4f82d23-47ef-462a-b8d1-580ca0712f5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:41.467329 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4f82d23-47ef-462a-b8d1-580ca0712f5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:41.467790 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4f82d23-47ef-462a-b8d1-580ca0712f5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:41.468743 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4f82d23-47ef-462a-b8d1-580ca0712f5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:41.607872 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-c4f82d23-47ef-462a-b8d1-580ca0712f5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:41.616169 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c4f82d23-47ef-462a-b8d1-580ca0712f5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1567 microversion: 2.1 time: 0.164615 Oct 17 04:36:41.616791 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 316/640] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:41 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:36:42.482286 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b65eeced-2eb3-430e-a781-c5c9e015be4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:42.482905 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b65eeced-2eb3-430e-a781-c5c9e015be4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:42.490230 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b65eeced-2eb3-430e-a781-c5c9e015be4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:42.490713 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b65eeced-2eb3-430e-a781-c5c9e015be4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:42.491145 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b65eeced-2eb3-430e-a781-c5c9e015be4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:42.491831 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b65eeced-2eb3-430e-a781-c5c9e015be4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:42.492283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b65eeced-2eb3-430e-a781-c5c9e015be4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:42.492707 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b65eeced-2eb3-430e-a781-c5c9e015be4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:42.625011 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b65eeced-2eb3-430e-a781-c5c9e015be4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:42.633319 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b65eeced-2eb3-430e-a781-c5c9e015be4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:42.634788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b65eeced-2eb3-430e-a781-c5c9e015be4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:42.636259 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b65eeced-2eb3-430e-a781-c5c9e015be4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.157913 Oct 17 04:36:42.637060 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 325/641] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:42 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:42.641464 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7ee57e5b-47a3-4049-9f4c-e101390f55a2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:42.642082 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7ee57e5b-47a3-4049-9f4c-e101390f55a2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:42.648155 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ee57e5b-47a3-4049-9f4c-e101390f55a2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:42.648644 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ee57e5b-47a3-4049-9f4c-e101390f55a2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:42.649100 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ee57e5b-47a3-4049-9f4c-e101390f55a2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:42.649910 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ee57e5b-47a3-4049-9f4c-e101390f55a2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:42.650373 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ee57e5b-47a3-4049-9f4c-e101390f55a2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:42.650796 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ee57e5b-47a3-4049-9f4c-e101390f55a2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:42.800039 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-7ee57e5b-47a3-4049-9f4c-e101390f55a2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:42.808093 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7ee57e5b-47a3-4049-9f4c-e101390f55a2 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1567 microversion: 2.1 time: 0.171336 Oct 17 04:36:42.808761 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 317/642] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:42 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:36:43.662640 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b3736ad0-bde8-44c6-a70b-88af3e1a05fc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:43.663247 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b3736ad0-bde8-44c6-a70b-88af3e1a05fc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:43.669657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3736ad0-bde8-44c6-a70b-88af3e1a05fc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:43.670140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3736ad0-bde8-44c6-a70b-88af3e1a05fc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:43.670572 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3736ad0-bde8-44c6-a70b-88af3e1a05fc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:43.671908 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3736ad0-bde8-44c6-a70b-88af3e1a05fc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:43.672415 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3736ad0-bde8-44c6-a70b-88af3e1a05fc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:43.672840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b3736ad0-bde8-44c6-a70b-88af3e1a05fc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:43.797454 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b3736ad0-bde8-44c6-a70b-88af3e1a05fc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:43.806132 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b3736ad0-bde8-44c6-a70b-88af3e1a05fc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:43.807670 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b3736ad0-bde8-44c6-a70b-88af3e1a05fc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:43.808958 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b3736ad0-bde8-44c6-a70b-88af3e1a05fc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.150232 Oct 17 04:36:43.817236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 326/643] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:43 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:43.833255 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7e76127e-9d19-472d-ac8b-9fd628007ae5 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:43.833877 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7e76127e-9d19-472d-ac8b-9fd628007ae5 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:43.840493 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e76127e-9d19-472d-ac8b-9fd628007ae5 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:43.841050 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e76127e-9d19-472d-ac8b-9fd628007ae5 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:43.841520 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e76127e-9d19-472d-ac8b-9fd628007ae5 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:43.842217 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e76127e-9d19-472d-ac8b-9fd628007ae5 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:43.842669 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e76127e-9d19-472d-ac8b-9fd628007ae5 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:43.843101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7e76127e-9d19-472d-ac8b-9fd628007ae5 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:43.977980 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-7e76127e-9d19-472d-ac8b-9fd628007ae5 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:43.985807 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7e76127e-9d19-472d-ac8b-9fd628007ae5 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1567 microversion: 2.1 time: 0.156588 Oct 17 04:36:43.986381 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 318/644] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:43 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:44.834679 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c99d3c9f-1e0a-4d9a-9f69-288814c1caa7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:44.835289 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c99d3c9f-1e0a-4d9a-9f69-288814c1caa7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:44.841800 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c99d3c9f-1e0a-4d9a-9f69-288814c1caa7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:44.842290 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c99d3c9f-1e0a-4d9a-9f69-288814c1caa7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:44.842725 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c99d3c9f-1e0a-4d9a-9f69-288814c1caa7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:44.843456 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c99d3c9f-1e0a-4d9a-9f69-288814c1caa7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:44.843959 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c99d3c9f-1e0a-4d9a-9f69-288814c1caa7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:44.844473 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c99d3c9f-1e0a-4d9a-9f69-288814c1caa7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:44.976784 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c99d3c9f-1e0a-4d9a-9f69-288814c1caa7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:44.985574 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c99d3c9f-1e0a-4d9a-9f69-288814c1caa7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:44.987035 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c99d3c9f-1e0a-4d9a-9f69-288814c1caa7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:44.988195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c99d3c9f-1e0a-4d9a-9f69-288814c1caa7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.157416 Oct 17 04:36:44.988754 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 327/645] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:44 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:45.007964 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f11f6b32-d2de-4db5-ad7f-952abddeb0d0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:45.008592 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f11f6b32-d2de-4db5-ad7f-952abddeb0d0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:45.015043 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f11f6b32-d2de-4db5-ad7f-952abddeb0d0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:45.015523 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f11f6b32-d2de-4db5-ad7f-952abddeb0d0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:45.015953 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f11f6b32-d2de-4db5-ad7f-952abddeb0d0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:45.016641 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f11f6b32-d2de-4db5-ad7f-952abddeb0d0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:45.017099 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f11f6b32-d2de-4db5-ad7f-952abddeb0d0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:45.017530 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f11f6b32-d2de-4db5-ad7f-952abddeb0d0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:45.164921 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f11f6b32-d2de-4db5-ad7f-952abddeb0d0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:45.172746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f11f6b32-d2de-4db5-ad7f-952abddeb0d0 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1568 microversion: 2.1 time: 0.168665 Oct 17 04:36:45.173548 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 319/646] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:45 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:45.196080 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c1120ebc-f520-4e05-9205-416e71cc9cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:36:45.196671 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c1120ebc-f520-4e05-9205-416e71cc9cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:45.203352 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1120ebc-f520-4e05-9205-416e71cc9cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:45.204054 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1120ebc-f520-4e05-9205-416e71cc9cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:45.204566 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1120ebc-f520-4e05-9205-416e71cc9cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:45.205352 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1120ebc-f520-4e05-9205-416e71cc9cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:45.205802 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1120ebc-f520-4e05-9205-416e71cc9cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:45.206246 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c1120ebc-f520-4e05-9205-416e71cc9cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:45.235383 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c1120ebc-f520-4e05-9205-416e71cc9cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119127) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 04:36:45.304235 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c1120ebc-f520-4e05-9205-416e71cc9cc3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "POST /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6/action" status: 202 len: 0 microversion: 2.1 time: 0.111998 Oct 17 04:36:45.305008 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 328/647] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Oct 17 04:36:45 2022] POST /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 04:36:45.313519 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-78532b1e-d6d1-47ec-bae8-7c3eda80305c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:45.314281 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-78532b1e-d6d1-47ec-bae8-7c3eda80305c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:45.320350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78532b1e-d6d1-47ec-bae8-7c3eda80305c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:45.321024 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78532b1e-d6d1-47ec-bae8-7c3eda80305c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:45.321499 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78532b1e-d6d1-47ec-bae8-7c3eda80305c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:45.324820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78532b1e-d6d1-47ec-bae8-7c3eda80305c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:45.325309 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78532b1e-d6d1-47ec-bae8-7c3eda80305c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:45.325740 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-78532b1e-d6d1-47ec-bae8-7c3eda80305c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:45.489102 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-78532b1e-d6d1-47ec-bae8-7c3eda80305c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:45.498852 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-78532b1e-d6d1-47ec-bae8-7c3eda80305c tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1516 microversion: 2.1 time: 0.189665 Oct 17 04:36:45.499860 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 320/648] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:45 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1516 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:46.015631 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-381200d6-6c04-416d-aa2b-790daf729b3c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:46.016376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-381200d6-6c04-416d-aa2b-790daf729b3c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:46.022855 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-381200d6-6c04-416d-aa2b-790daf729b3c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:46.023445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-381200d6-6c04-416d-aa2b-790daf729b3c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:46.024267 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-381200d6-6c04-416d-aa2b-790daf729b3c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:46.025209 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-381200d6-6c04-416d-aa2b-790daf729b3c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:46.025737 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-381200d6-6c04-416d-aa2b-790daf729b3c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:46.026263 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-381200d6-6c04-416d-aa2b-790daf729b3c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:46.031050 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:36:46.162998 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-381200d6-6c04-416d-aa2b-790daf729b3c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:46.172578 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-381200d6-6c04-416d-aa2b-790daf729b3c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:46.174175 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-381200d6-6c04-416d-aa2b-790daf729b3c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:46.175451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-381200d6-6c04-416d-aa2b-790daf729b3c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.165612 Oct 17 04:36:46.176068 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 329/649] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:46 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:46.525145 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e221d030-0ade-4449-9ef2-92b3a094ec3f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:46.525753 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e221d030-0ade-4449-9ef2-92b3a094ec3f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:46.532260 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e221d030-0ade-4449-9ef2-92b3a094ec3f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:46.532739 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e221d030-0ade-4449-9ef2-92b3a094ec3f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:46.533211 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e221d030-0ade-4449-9ef2-92b3a094ec3f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:46.534005 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e221d030-0ade-4449-9ef2-92b3a094ec3f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:46.534461 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e221d030-0ade-4449-9ef2-92b3a094ec3f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:46.534878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e221d030-0ade-4449-9ef2-92b3a094ec3f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:46.668608 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e221d030-0ade-4449-9ef2-92b3a094ec3f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:46.676421 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e221d030-0ade-4449-9ef2-92b3a094ec3f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1518 microversion: 2.1 time: 0.155156 Oct 17 04:36:46.677023 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 321/650] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:46 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:47.018791 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-35c45484-d7d9-4aad-8b6a-e30cb4db3915 req-e23c2792-d8a9-4f62-bc11-213e96a4ade7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c04fcc98-6f6b-4092-ba63-364498327bb6", "name": "network-vif-unplugged", "status": "completed", "tag": "5018bca9-d0fd-4019-a69a-d25003f4d4da"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:36:47.029146 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-35c45484-d7d9-4aad-8b6a-e30cb4db3915 req-e23c2792-d8a9-4f62-bc11-213e96a4ade7 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:47.029797 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-35c45484-d7d9-4aad-8b6a-e30cb4db3915 req-e23c2792-d8a9-4f62-bc11-213e96a4ade7 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:47.030037 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-35c45484-d7d9-4aad-8b6a-e30cb4db3915 req-e23c2792-d8a9-4f62-bc11-213e96a4ade7 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:47.044015 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.compute.server_external_events [req-35c45484-d7d9-4aad-8b6a-e30cb4db3915 req-e23c2792-d8a9-4f62-bc11-213e96a4ade7 service nova] Unable to find a host for instance c04fcc98-6f6b-4092-ba63-364498327bb6. Dropping event network-vif-unplugged {{(pid=119127) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 04:36:47.044919 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-35c45484-d7d9-4aad-8b6a-e30cb4db3915 req-e23c2792-d8a9-4f62-bc11-213e96a4ade7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.188436 Oct 17 04:36:47.045528 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 330/651] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 190 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 04:36:47.130070 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3ad97058-3e81-45ee-9720-01cf22edc30f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:47.132476 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3ad97058-3e81-45ee-9720-01cf22edc30f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:47.139026 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ad97058-3e81-45ee-9720-01cf22edc30f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:47.139788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ad97058-3e81-45ee-9720-01cf22edc30f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:47.140312 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ad97058-3e81-45ee-9720-01cf22edc30f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:47.141134 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ad97058-3e81-45ee-9720-01cf22edc30f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:47.141876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ad97058-3e81-45ee-9720-01cf22edc30f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:47.142304 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ad97058-3e81-45ee-9720-01cf22edc30f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:47.173279 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3ad97058-3e81-45ee-9720-01cf22edc30f tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047203 Oct 17 04:36:47.173841 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 322/652] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:36:47 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:36:47.185109 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff4eebeb-49f3-4bbd-9a33-f383b0994ee9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:47.185680 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff4eebeb-49f3-4bbd-9a33-f383b0994ee9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:47.192141 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff4eebeb-49f3-4bbd-9a33-f383b0994ee9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:47.192633 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff4eebeb-49f3-4bbd-9a33-f383b0994ee9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:47.193113 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff4eebeb-49f3-4bbd-9a33-f383b0994ee9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:47.193812 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff4eebeb-49f3-4bbd-9a33-f383b0994ee9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:47.194265 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff4eebeb-49f3-4bbd-9a33-f383b0994ee9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:47.194688 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff4eebeb-49f3-4bbd-9a33-f383b0994ee9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:47.200757 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8a4a3d04-8575-4b59-98bc-61eee6b309f6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:47.201486 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8a4a3d04-8575-4b59-98bc-61eee6b309f6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:47.207688 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8a4a3d04-8575-4b59-98bc-61eee6b309f6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:47.208167 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8a4a3d04-8575-4b59-98bc-61eee6b309f6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:47.208597 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8a4a3d04-8575-4b59-98bc-61eee6b309f6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:47.209308 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8a4a3d04-8575-4b59-98bc-61eee6b309f6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:47.210221 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8a4a3d04-8575-4b59-98bc-61eee6b309f6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:47.210221 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8a4a3d04-8575-4b59-98bc-61eee6b309f6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:47.227407 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff4eebeb-49f3-4bbd-9a33-f383b0994ee9 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments/40fbe1a4-9944-44ba-a524-b1b02703569a" status: 200 len: 194 microversion: 2.1 time: 0.046325 Oct 17 04:36:47.228047 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 331/653] 10.222.0.40 () {58 vars in 1413 bytes} [Mon Oct 17 04:36:47 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments/40fbe1a4-9944-44ba-a524-b1b02703569a => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:36:47.355322 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-8a4a3d04-8575-4b59-98bc-61eee6b309f6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:47.364638 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-8a4a3d04-8575-4b59-98bc-61eee6b309f6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:47.366125 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-8a4a3d04-8575-4b59-98bc-61eee6b309f6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:47.367295 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8a4a3d04-8575-4b59-98bc-61eee6b309f6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.170386 Oct 17 04:36:47.367857 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 323/654] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:47 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:36:47.699797 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-589bb916-8644-4f1f-87b5-ea264cbe834f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:47.700411 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-589bb916-8644-4f1f-87b5-ea264cbe834f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:47.706791 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-589bb916-8644-4f1f-87b5-ea264cbe834f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:47.707272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-589bb916-8644-4f1f-87b5-ea264cbe834f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:47.707710 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-589bb916-8644-4f1f-87b5-ea264cbe834f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:47.708394 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-589bb916-8644-4f1f-87b5-ea264cbe834f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:47.708845 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-589bb916-8644-4f1f-87b5-ea264cbe834f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:47.709293 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-589bb916-8644-4f1f-87b5-ea264cbe834f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:47.845674 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-589bb916-8644-4f1f-87b5-ea264cbe834f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:47.853454 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-589bb916-8644-4f1f-87b5-ea264cbe834f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1574 microversion: 2.1 time: 0.157685 Oct 17 04:36:47.854022 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 332/655] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:47 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:48.395990 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1fa63302-5f97-4c56-a17b-3bd7bff3d1a0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:48.396598 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1fa63302-5f97-4c56-a17b-3bd7bff3d1a0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:48.403346 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fa63302-5f97-4c56-a17b-3bd7bff3d1a0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:48.403831 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fa63302-5f97-4c56-a17b-3bd7bff3d1a0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:48.404260 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fa63302-5f97-4c56-a17b-3bd7bff3d1a0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:48.404957 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fa63302-5f97-4c56-a17b-3bd7bff3d1a0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:48.405435 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fa63302-5f97-4c56-a17b-3bd7bff3d1a0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:48.406929 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fa63302-5f97-4c56-a17b-3bd7bff3d1a0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:48.541529 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-1fa63302-5f97-4c56-a17b-3bd7bff3d1a0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:48.550786 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-1fa63302-5f97-4c56-a17b-3bd7bff3d1a0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:48.552544 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-1fa63302-5f97-4c56-a17b-3bd7bff3d1a0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:48.553874 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1fa63302-5f97-4c56-a17b-3bd7bff3d1a0 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.161842 Oct 17 04:36:48.554527 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 324/656] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:48 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:36:48.601972 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-71be927a-969e-4c07-9735-d6d60d55915c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b8eeaa5-bf4f-42b9-bf93-348339386f37"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:36:48.604279 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-71be927a-969e-4c07-9735-d6d60d55915c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:48.610617 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71be927a-969e-4c07-9735-d6d60d55915c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:48.611105 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71be927a-969e-4c07-9735-d6d60d55915c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:48.611541 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71be927a-969e-4c07-9735-d6d60d55915c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:48.612235 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71be927a-969e-4c07-9735-d6d60d55915c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:48.612686 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71be927a-969e-4c07-9735-d6d60d55915c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:48.613135 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71be927a-969e-4c07-9735-d6d60d55915c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:48.857901 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-71be927a-969e-4c07-9735-d6d60d55915c tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "POST /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259736 Oct 17 04:36:48.858650 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 333/657] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Oct 17 04:36:48 2022] POST /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:36:48.877914 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4a1e697a-2881-46eb-a6bf-1f1ebfd9c1cc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:48.878525 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4a1e697a-2881-46eb-a6bf-1f1ebfd9c1cc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:48.885442 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a1e697a-2881-46eb-a6bf-1f1ebfd9c1cc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:48.886112 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a1e697a-2881-46eb-a6bf-1f1ebfd9c1cc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:48.886543 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a1e697a-2881-46eb-a6bf-1f1ebfd9c1cc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:48.887228 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a1e697a-2881-46eb-a6bf-1f1ebfd9c1cc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:48.887678 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a1e697a-2881-46eb-a6bf-1f1ebfd9c1cc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:48.888094 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a1e697a-2881-46eb-a6bf-1f1ebfd9c1cc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:49.027138 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-4a1e697a-2881-46eb-a6bf-1f1ebfd9c1cc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:49.035074 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4a1e697a-2881-46eb-a6bf-1f1ebfd9c1cc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1574 microversion: 2.1 time: 0.161571 Oct 17 04:36:49.035667 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 325/658] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:48 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:49.579808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-004901f7-ade2-47e9-9a5b-03decb1dd448 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:49.580498 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-004901f7-ade2-47e9-9a5b-03decb1dd448 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:49.586663 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-004901f7-ade2-47e9-9a5b-03decb1dd448 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:49.587139 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-004901f7-ade2-47e9-9a5b-03decb1dd448 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:49.587572 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-004901f7-ade2-47e9-9a5b-03decb1dd448 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:49.588253 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-004901f7-ade2-47e9-9a5b-03decb1dd448 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:49.588699 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-004901f7-ade2-47e9-9a5b-03decb1dd448 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:49.589139 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-004901f7-ade2-47e9-9a5b-03decb1dd448 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:49.714963 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-004901f7-ade2-47e9-9a5b-03decb1dd448 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:49.723459 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-004901f7-ade2-47e9-9a5b-03decb1dd448 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:49.724897 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-004901f7-ade2-47e9-9a5b-03decb1dd448 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:49.726089 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-004901f7-ade2-47e9-9a5b-03decb1dd448 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.151376 Oct 17 04:36:49.726642 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 334/659] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:49 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:50.058510 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-54196088-4365-457c-a85e-c6d5d4eab774 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:50.059130 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-54196088-4365-457c-a85e-c6d5d4eab774 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:50.065647 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-54196088-4365-457c-a85e-c6d5d4eab774 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:50.066153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-54196088-4365-457c-a85e-c6d5d4eab774 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:50.066588 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-54196088-4365-457c-a85e-c6d5d4eab774 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:50.067277 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-54196088-4365-457c-a85e-c6d5d4eab774 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:50.067727 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-54196088-4365-457c-a85e-c6d5d4eab774 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:50.068147 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-54196088-4365-457c-a85e-c6d5d4eab774 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:50.195026 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-54196088-4365-457c-a85e-c6d5d4eab774 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:50.203348 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-54196088-4365-457c-a85e-c6d5d4eab774 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1574 microversion: 2.1 time: 0.148646 Oct 17 04:36:50.203918 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 326/660] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:50 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:50.751824 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5bede05d-110b-4cd9-867f-7fddecd5055a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:50.752357 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5bede05d-110b-4cd9-867f-7fddecd5055a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:50.758720 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5bede05d-110b-4cd9-867f-7fddecd5055a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:50.759196 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5bede05d-110b-4cd9-867f-7fddecd5055a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:50.759811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5bede05d-110b-4cd9-867f-7fddecd5055a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:50.760649 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5bede05d-110b-4cd9-867f-7fddecd5055a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:50.761292 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5bede05d-110b-4cd9-867f-7fddecd5055a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:50.761708 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5bede05d-110b-4cd9-867f-7fddecd5055a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:50.927923 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5bede05d-110b-4cd9-867f-7fddecd5055a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:50.936425 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5bede05d-110b-4cd9-867f-7fddecd5055a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:50.938577 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5bede05d-110b-4cd9-867f-7fddecd5055a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:50.939601 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5bede05d-110b-4cd9-867f-7fddecd5055a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.191907 Oct 17 04:36:50.940162 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 335/661] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:50 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:51.227160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9d69fb44-3564-45a6-a59c-ef9d4cada185 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:51.227779 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9d69fb44-3564-45a6-a59c-ef9d4cada185 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:51.235461 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d69fb44-3564-45a6-a59c-ef9d4cada185 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:51.235954 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d69fb44-3564-45a6-a59c-ef9d4cada185 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:51.236386 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d69fb44-3564-45a6-a59c-ef9d4cada185 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:51.237120 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d69fb44-3564-45a6-a59c-ef9d4cada185 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:51.237577 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d69fb44-3564-45a6-a59c-ef9d4cada185 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:51.237999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d69fb44-3564-45a6-a59c-ef9d4cada185 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:51.375932 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-9d69fb44-3564-45a6-a59c-ef9d4cada185 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:51.384717 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9d69fb44-3564-45a6-a59c-ef9d4cada185 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1574 microversion: 2.1 time: 0.161613 Oct 17 04:36:51.385318 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 327/662] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:51 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:51.965465 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-883abb5b-480e-4538-ae87-2339690974f9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:51.965844 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-883abb5b-480e-4538-ae87-2339690974f9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:51.972642 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-883abb5b-480e-4538-ae87-2339690974f9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:51.973150 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-883abb5b-480e-4538-ae87-2339690974f9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:51.973588 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-883abb5b-480e-4538-ae87-2339690974f9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:51.974274 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-883abb5b-480e-4538-ae87-2339690974f9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:51.974723 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-883abb5b-480e-4538-ae87-2339690974f9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:51.975144 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-883abb5b-480e-4538-ae87-2339690974f9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:52.104653 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-883abb5b-480e-4538-ae87-2339690974f9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:52.112875 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-883abb5b-480e-4538-ae87-2339690974f9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:52.114380 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-883abb5b-480e-4538-ae87-2339690974f9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:52.115543 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-883abb5b-480e-4538-ae87-2339690974f9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.154402 Oct 17 04:36:52.116108 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 336/663] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:51 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:52.408397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e905f9dd-3f42-4242-a0af-6375b9b29819 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:52.409009 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e905f9dd-3f42-4242-a0af-6375b9b29819 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:52.415462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e905f9dd-3f42-4242-a0af-6375b9b29819 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:52.415939 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e905f9dd-3f42-4242-a0af-6375b9b29819 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:52.416375 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e905f9dd-3f42-4242-a0af-6375b9b29819 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:52.417061 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e905f9dd-3f42-4242-a0af-6375b9b29819 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:52.417533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e905f9dd-3f42-4242-a0af-6375b9b29819 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:52.417964 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e905f9dd-3f42-4242-a0af-6375b9b29819 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:52.550627 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e905f9dd-3f42-4242-a0af-6375b9b29819 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:52.558298 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e905f9dd-3f42-4242-a0af-6375b9b29819 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1574 microversion: 2.1 time: 0.154541 Oct 17 04:36:52.558856 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 328/664] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:52 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:52.725891 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ce11f3a4-7e0c-4a28-81f4-345aa83ca6e6 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:52.726295 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ce11f3a4-7e0c-4a28-81f4-345aa83ca6e6 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:52.732191 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce11f3a4-7e0c-4a28-81f4-345aa83ca6e6 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:52.732674 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce11f3a4-7e0c-4a28-81f4-345aa83ca6e6 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:52.733140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce11f3a4-7e0c-4a28-81f4-345aa83ca6e6 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:52.733841 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce11f3a4-7e0c-4a28-81f4-345aa83ca6e6 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:52.734384 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce11f3a4-7e0c-4a28-81f4-345aa83ca6e6 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:52.734813 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ce11f3a4-7e0c-4a28-81f4-345aa83ca6e6 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:52.758299 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ce11f3a4-7e0c-4a28-81f4-345aa83ca6e6 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5/ips" status: 200 len: 150 microversion: 2.1 time: 0.036411 Oct 17 04:36:52.758925 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 337/665] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Oct 17 04:36:52 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:36:53.141043 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2b9d69d5-b868-47bc-8ed1-7b57305ae392 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:53.141695 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2b9d69d5-b868-47bc-8ed1-7b57305ae392 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:53.147624 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b9d69d5-b868-47bc-8ed1-7b57305ae392 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:53.148122 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b9d69d5-b868-47bc-8ed1-7b57305ae392 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:53.148563 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b9d69d5-b868-47bc-8ed1-7b57305ae392 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:53.149306 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b9d69d5-b868-47bc-8ed1-7b57305ae392 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:53.149768 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b9d69d5-b868-47bc-8ed1-7b57305ae392 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:53.150194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2b9d69d5-b868-47bc-8ed1-7b57305ae392 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:53.278374 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-2b9d69d5-b868-47bc-8ed1-7b57305ae392 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:53.287049 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-2b9d69d5-b868-47bc-8ed1-7b57305ae392 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:53.288498 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-2b9d69d5-b868-47bc-8ed1-7b57305ae392 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:53.289680 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2b9d69d5-b868-47bc-8ed1-7b57305ae392 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.152702 Oct 17 04:36:53.290247 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 329/666] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:53 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:53.583207 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5d03c12d-6ae1-4f8d-ad2e-da710b81f4dc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:53.583721 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5d03c12d-6ae1-4f8d-ad2e-da710b81f4dc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:53.589943 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d03c12d-6ae1-4f8d-ad2e-da710b81f4dc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:53.590416 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d03c12d-6ae1-4f8d-ad2e-da710b81f4dc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:53.590843 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d03c12d-6ae1-4f8d-ad2e-da710b81f4dc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:53.591527 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d03c12d-6ae1-4f8d-ad2e-da710b81f4dc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:53.591973 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d03c12d-6ae1-4f8d-ad2e-da710b81f4dc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:53.592390 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d03c12d-6ae1-4f8d-ad2e-da710b81f4dc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:53.722386 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5d03c12d-6ae1-4f8d-ad2e-da710b81f4dc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:53.730164 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5d03c12d-6ae1-4f8d-ad2e-da710b81f4dc tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1574 microversion: 2.1 time: 0.150982 Oct 17 04:36:53.730731 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 338/667] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:53 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:54.092613 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-336d1c01-b9f9-4012-ae5d-337bbc73b4a7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80aae0fa-78d7-441d-bbcd-499521a0d43c"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:36:54.095041 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-336d1c01-b9f9-4012-ae5d-337bbc73b4a7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:54.101371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-336d1c01-b9f9-4012-ae5d-337bbc73b4a7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:54.101844 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-336d1c01-b9f9-4012-ae5d-337bbc73b4a7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:54.102276 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-336d1c01-b9f9-4012-ae5d-337bbc73b4a7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:54.102956 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-336d1c01-b9f9-4012-ae5d-337bbc73b4a7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:54.103405 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-336d1c01-b9f9-4012-ae5d-337bbc73b4a7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:54.103826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-336d1c01-b9f9-4012-ae5d-337bbc73b4a7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:54.315890 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3597c88c-0cfa-4a00-9f34-bc0025be3c92 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:54.316428 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3597c88c-0cfa-4a00-9f34-bc0025be3c92 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:54.322422 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3597c88c-0cfa-4a00-9f34-bc0025be3c92 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:54.322911 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3597c88c-0cfa-4a00-9f34-bc0025be3c92 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:54.323350 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3597c88c-0cfa-4a00-9f34-bc0025be3c92 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:54.324038 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3597c88c-0cfa-4a00-9f34-bc0025be3c92 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:54.324492 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3597c88c-0cfa-4a00-9f34-bc0025be3c92 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:54.324939 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3597c88c-0cfa-4a00-9f34-bc0025be3c92 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:54.452065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-3597c88c-0cfa-4a00-9f34-bc0025be3c92 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:54.460877 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-3597c88c-0cfa-4a00-9f34-bc0025be3c92 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:54.462361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-3597c88c-0cfa-4a00-9f34-bc0025be3c92 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:54.463518 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3597c88c-0cfa-4a00-9f34-bc0025be3c92 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.152339 Oct 17 04:36:54.464075 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 339/668] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:54 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:36:54.754236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-baa02ce0-c277-420c-8d59-27acf13467e3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:54.754910 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-baa02ce0-c277-420c-8d59-27acf13467e3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:54.761156 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-baa02ce0-c277-420c-8d59-27acf13467e3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:54.761631 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-baa02ce0-c277-420c-8d59-27acf13467e3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:54.762066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-baa02ce0-c277-420c-8d59-27acf13467e3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:54.762746 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-baa02ce0-c277-420c-8d59-27acf13467e3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:54.763190 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-baa02ce0-c277-420c-8d59-27acf13467e3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:54.763621 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-baa02ce0-c277-420c-8d59-27acf13467e3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:54.892715 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-baa02ce0-c277-420c-8d59-27acf13467e3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:54.900579 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-baa02ce0-c277-420c-8d59-27acf13467e3 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1574 microversion: 2.1 time: 0.150530 Oct 17 04:36:54.901171 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 340/669] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:54 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:36:55.360581 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:36:55.382705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-336d1c01-b9f9-4012-ae5d-337bbc73b4a7 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "POST /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.293786 Oct 17 04:36:55.383275 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 330/670] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Oct 17 04:36:54 2022] POST /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5/os-volume_attachments => generated 194 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:36:55.489469 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6f3d6122-ab5e-4b5f-bd71-8186689aba6a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:55.490076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6f3d6122-ab5e-4b5f-bd71-8186689aba6a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:55.495931 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f3d6122-ab5e-4b5f-bd71-8186689aba6a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:55.496410 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f3d6122-ab5e-4b5f-bd71-8186689aba6a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:55.496844 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f3d6122-ab5e-4b5f-bd71-8186689aba6a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:55.497556 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f3d6122-ab5e-4b5f-bd71-8186689aba6a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:55.498007 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f3d6122-ab5e-4b5f-bd71-8186689aba6a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:55.498427 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f3d6122-ab5e-4b5f-bd71-8186689aba6a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:55.628686 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-6f3d6122-ab5e-4b5f-bd71-8186689aba6a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:55.636834 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-6f3d6122-ab5e-4b5f-bd71-8186689aba6a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:55.638280 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-6f3d6122-ab5e-4b5f-bd71-8186689aba6a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:55.639449 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6f3d6122-ab5e-4b5f-bd71-8186689aba6a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1742 microversion: 2.20 time: 0.153843 Oct 17 04:36:55.640144 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 341/671] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:55 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:55.925789 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-41cac1de-dc27-4cbe-9918-a792108028d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:55.926520 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-41cac1de-dc27-4cbe-9918-a792108028d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:55.933828 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41cac1de-dc27-4cbe-9918-a792108028d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:55.934314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41cac1de-dc27-4cbe-9918-a792108028d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:55.934755 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41cac1de-dc27-4cbe-9918-a792108028d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:55.935563 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41cac1de-dc27-4cbe-9918-a792108028d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:55.936107 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41cac1de-dc27-4cbe-9918-a792108028d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:55.936777 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41cac1de-dc27-4cbe-9918-a792108028d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:56.080462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-41cac1de-dc27-4cbe-9918-a792108028d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:56.088264 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-41cac1de-dc27-4cbe-9918-a792108028d1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1574 microversion: 2.1 time: 0.166782 Oct 17 04:36:56.088840 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 331/672] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:55 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:56.404062 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6c428920-6b63-4cdc-b736-eb5d86abd103 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:56.407003 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6c428920-6b63-4cdc-b736-eb5d86abd103 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:56.413415 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c428920-6b63-4cdc-b736-eb5d86abd103 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:56.413898 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c428920-6b63-4cdc-b736-eb5d86abd103 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:56.414334 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c428920-6b63-4cdc-b736-eb5d86abd103 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:56.415025 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c428920-6b63-4cdc-b736-eb5d86abd103 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:56.415481 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c428920-6b63-4cdc-b736-eb5d86abd103 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:56.415938 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6c428920-6b63-4cdc-b736-eb5d86abd103 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:56.446312 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6c428920-6b63-4cdc-b736-eb5d86abd103 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046148 Oct 17 04:36:56.446874 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 342/673] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:36:56 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:36:56.589246 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-84bd2978-4b3b-4720-83ed-28447e86bdd2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:56.589754 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-84bd2978-4b3b-4720-83ed-28447e86bdd2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:56.596067 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-84bd2978-4b3b-4720-83ed-28447e86bdd2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:56.596547 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-84bd2978-4b3b-4720-83ed-28447e86bdd2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:56.596983 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-84bd2978-4b3b-4720-83ed-28447e86bdd2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:56.597701 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-84bd2978-4b3b-4720-83ed-28447e86bdd2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:56.598158 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-84bd2978-4b3b-4720-83ed-28447e86bdd2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:56.598581 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-84bd2978-4b3b-4720-83ed-28447e86bdd2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:56.629951 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-84bd2978-4b3b-4720-83ed-28447e86bdd2 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments/40fbe1a4-9944-44ba-a524-b1b02703569a" status: 200 len: 194 microversion: 2.1 time: 0.044807 Oct 17 04:36:56.630465 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 332/674] 10.222.0.40 () {58 vars in 1413 bytes} [Mon Oct 17 04:36:56 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments/40fbe1a4-9944-44ba-a524-b1b02703569a => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:36:56.640780 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-79e33566-0702-4760-be0c-49a01198481e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:56.641322 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-79e33566-0702-4760-be0c-49a01198481e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:56.647101 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79e33566-0702-4760-be0c-49a01198481e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:56.647573 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79e33566-0702-4760-be0c-49a01198481e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:56.648000 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79e33566-0702-4760-be0c-49a01198481e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:56.648675 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79e33566-0702-4760-be0c-49a01198481e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:56.649143 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79e33566-0702-4760-be0c-49a01198481e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:56.649569 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-79e33566-0702-4760-be0c-49a01198481e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:56.665511 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-91115fa5-5f72-4ccf-9df7-fbc6604abb4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:56.666120 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-91115fa5-5f72-4ccf-9df7-fbc6604abb4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:56.672542 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91115fa5-5f72-4ccf-9df7-fbc6604abb4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:56.673020 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91115fa5-5f72-4ccf-9df7-fbc6604abb4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:56.673475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91115fa5-5f72-4ccf-9df7-fbc6604abb4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:56.674158 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91115fa5-5f72-4ccf-9df7-fbc6604abb4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:56.674609 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91115fa5-5f72-4ccf-9df7-fbc6604abb4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:56.675029 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-91115fa5-5f72-4ccf-9df7-fbc6604abb4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:56.730353 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-79e33566-0702-4760-be0c-49a01198481e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lazy-loading 'services' on Instance uuid 8fb709e6-ba7f-4703-8f7f-365c33a1c79c {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:36:56.805597 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-79e33566-0702-4760-be0c-49a01198481e tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments/40fbe1a4-9944-44ba-a524-b1b02703569a" status: 202 len: 0 microversion: 2.1 time: 0.168578 Oct 17 04:36:56.806322 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 343/675] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Oct 17 04:36:56 2022] DELETE /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments/40fbe1a4-9944-44ba-a524-b1b02703569a => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:36:56.807882 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-91115fa5-5f72-4ccf-9df7-fbc6604abb4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:56.817622 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-91115fa5-5f72-4ccf-9df7-fbc6604abb4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:56.819072 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-91115fa5-5f72-4ccf-9df7-fbc6604abb4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:56.820434 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-91115fa5-5f72-4ccf-9df7-fbc6604abb4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1742 microversion: 2.20 time: 0.158787 Oct 17 04:36:56.821350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 333/676] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:56 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:36:57.112795 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bce90f5d-313f-4254-80fe-f3097965546b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:57.113530 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bce90f5d-313f-4254-80fe-f3097965546b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:57.119685 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bce90f5d-313f-4254-80fe-f3097965546b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:57.120174 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bce90f5d-313f-4254-80fe-f3097965546b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:57.120606 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bce90f5d-313f-4254-80fe-f3097965546b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:57.121332 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bce90f5d-313f-4254-80fe-f3097965546b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:57.121869 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bce90f5d-313f-4254-80fe-f3097965546b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:57.122281 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bce90f5d-313f-4254-80fe-f3097965546b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:57.262435 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-bce90f5d-313f-4254-80fe-f3097965546b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:57.266615 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:36:57.271961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bce90f5d-313f-4254-80fe-f3097965546b tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1574 microversion: 2.1 time: 0.164110 Oct 17 04:36:57.272628 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 344/677] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:57 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:57.848101 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ac935e70-76d8-4d59-8a63-8629c4dbbed9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:57.848792 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ac935e70-76d8-4d59-8a63-8629c4dbbed9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:57.855305 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ac935e70-76d8-4d59-8a63-8629c4dbbed9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:57.856047 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ac935e70-76d8-4d59-8a63-8629c4dbbed9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:57.856489 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ac935e70-76d8-4d59-8a63-8629c4dbbed9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:57.857326 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ac935e70-76d8-4d59-8a63-8629c4dbbed9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:57.857781 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ac935e70-76d8-4d59-8a63-8629c4dbbed9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:57.858201 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ac935e70-76d8-4d59-8a63-8629c4dbbed9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:58.006804 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-ac935e70-76d8-4d59-8a63-8629c4dbbed9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:58.015883 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-ac935e70-76d8-4d59-8a63-8629c4dbbed9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:58.017372 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-ac935e70-76d8-4d59-8a63-8629c4dbbed9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:58.018634 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ac935e70-76d8-4d59-8a63-8629c4dbbed9 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1737 microversion: 2.20 time: 0.174739 Oct 17 04:36:58.033103 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 334/678] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:57 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:58.296555 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f0991f26-e434-4440-a520-f242b6eb1ef4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:58.297194 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f0991f26-e434-4440-a520-f242b6eb1ef4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:58.299518 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:36:58.305202 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0991f26-e434-4440-a520-f242b6eb1ef4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:58.305687 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0991f26-e434-4440-a520-f242b6eb1ef4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:58.306124 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0991f26-e434-4440-a520-f242b6eb1ef4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:58.306821 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0991f26-e434-4440-a520-f242b6eb1ef4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:58.307272 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0991f26-e434-4440-a520-f242b6eb1ef4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:58.307704 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f0991f26-e434-4440-a520-f242b6eb1ef4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:58.465777 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f0991f26-e434-4440-a520-f242b6eb1ef4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:58.477002 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f0991f26-e434-4440-a520-f242b6eb1ef4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1574 microversion: 2.1 time: 0.185364 Oct 17 04:36:58.477609 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 345/679] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:58 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:36:58.979362 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-78b90b24-f137-4744-8c98-130f396e7e12 req-a4de5f4e-6147-4cf6-a4a7-f1baf80aee8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58170c9-886a-45c1-9c0e-acfb37fab782", "name": "network-vif-plugged", "status": "completed", "tag": "0c4b79b8-f091-4221-b5d8-ad21adc83468"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:36:59.002456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-78b90b24-f137-4744-8c98-130f396e7e12 req-a4de5f4e-6147-4cf6-a4a7-f1baf80aee8a service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:59.006574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-78b90b24-f137-4744-8c98-130f396e7e12 req-a4de5f4e-6147-4cf6-a4a7-f1baf80aee8a service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:59.007031 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-78b90b24-f137-4744-8c98-130f396e7e12 req-a4de5f4e-6147-4cf6-a4a7-f1baf80aee8a service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:59.026370 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-78b90b24-f137-4744-8c98-130f396e7e12 req-a4de5f4e-6147-4cf6-a4a7-f1baf80aee8a service nova] Creating event network-vif-plugged:0c4b79b8-f091-4221-b5d8-ad21adc83468 for instance e58170c9-886a-45c1-9c0e-acfb37fab782 on hv-cinder-86155 Oct 17 04:36:59.045319 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-78b90b24-f137-4744-8c98-130f396e7e12 req-a4de5f4e-6147-4cf6-a4a7-f1baf80aee8a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071924 Oct 17 04:36:59.047082 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7051065f-5f34-4540-9484-6afb5df73455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:59.047946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7051065f-5f34-4540-9484-6afb5df73455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:59.049952 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 335/680] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:36:59.054469 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7051065f-5f34-4540-9484-6afb5df73455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:59.054986 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7051065f-5f34-4540-9484-6afb5df73455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:59.055654 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7051065f-5f34-4540-9484-6afb5df73455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:59.056438 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7051065f-5f34-4540-9484-6afb5df73455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:59.059156 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7051065f-5f34-4540-9484-6afb5df73455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:59.059837 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7051065f-5f34-4540-9484-6afb5df73455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:59.238049 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-7051065f-5f34-4540-9484-6afb5df73455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:59.257047 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-7051065f-5f34-4540-9484-6afb5df73455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:59.258596 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-7051065f-5f34-4540-9484-6afb5df73455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:59.259794 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7051065f-5f34-4540-9484-6afb5df73455 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1737 microversion: 2.20 time: 0.217679 Oct 17 04:36:59.261722 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 346/681] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:36:59 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:36:59.500877 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a1bebb05-a288-4a75-8208-46ff4d62f246 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:36:59.504980 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a1bebb05-a288-4a75-8208-46ff4d62f246 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:36:59.508489 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=65 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:36:59.514324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1bebb05-a288-4a75-8208-46ff4d62f246 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:59.515641 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1bebb05-a288-4a75-8208-46ff4d62f246 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:59.516196 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1bebb05-a288-4a75-8208-46ff4d62f246 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:59.517029 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1bebb05-a288-4a75-8208-46ff4d62f246 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:36:59.517575 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1bebb05-a288-4a75-8208-46ff4d62f246 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:36:59.518005 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a1bebb05-a288-4a75-8208-46ff4d62f246 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:36:59.685575 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-a1bebb05-a288-4a75-8208-46ff4d62f246 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:36:59.695475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a1bebb05-a288-4a75-8208-46ff4d62f246 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1574 microversion: 2.1 time: 0.199398 Oct 17 04:36:59.696257 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 336/682] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:36:59 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1574 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:00.285660 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-68d8a988-1018-4bf1-9c31-83639168afc6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:00.286849 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-68d8a988-1018-4bf1-9c31-83639168afc6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:00.293163 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-68d8a988-1018-4bf1-9c31-83639168afc6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:00.293716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-68d8a988-1018-4bf1-9c31-83639168afc6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:00.294218 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-68d8a988-1018-4bf1-9c31-83639168afc6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:00.294976 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-68d8a988-1018-4bf1-9c31-83639168afc6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:00.295427 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-68d8a988-1018-4bf1-9c31-83639168afc6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:00.295908 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-68d8a988-1018-4bf1-9c31-83639168afc6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:00.437263 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-68d8a988-1018-4bf1-9c31-83639168afc6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:00.445739 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-68d8a988-1018-4bf1-9c31-83639168afc6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:00.447196 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-68d8a988-1018-4bf1-9c31-83639168afc6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:00.448368 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-68d8a988-1018-4bf1-9c31-83639168afc6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1737 microversion: 2.20 time: 0.166685 Oct 17 04:37:00.456781 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 347/683] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:00 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:00.724618 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d3993192-5fcd-4381-8a72-760faa3e1120 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:00.725371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d3993192-5fcd-4381-8a72-760faa3e1120 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:00.735865 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3993192-5fcd-4381-8a72-760faa3e1120 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:00.736386 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3993192-5fcd-4381-8a72-760faa3e1120 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:00.736822 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3993192-5fcd-4381-8a72-760faa3e1120 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:00.737559 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3993192-5fcd-4381-8a72-760faa3e1120 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:00.739373 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3993192-5fcd-4381-8a72-760faa3e1120 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:00.740952 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3993192-5fcd-4381-8a72-760faa3e1120 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:00.896889 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d3993192-5fcd-4381-8a72-760faa3e1120 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:00.905624 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d3993192-5fcd-4381-8a72-760faa3e1120 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1574 microversion: 2.1 time: 0.184651 Oct 17 04:37:00.906493 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 337/684] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:00 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1574 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:01.104786 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-3a41562e-a73d-496b-b349-457b80e09fd9 req-defb76be-cba4-419d-9606-3f539744080f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c04fcc98-6f6b-4092-ba63-364498327bb6", "name": "network-vif-plugged", "status": "completed", "tag": "5018bca9-d0fd-4019-a69a-d25003f4d4da"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:37:01.147234 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3a41562e-a73d-496b-b349-457b80e09fd9 req-defb76be-cba4-419d-9606-3f539744080f service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:01.147712 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3a41562e-a73d-496b-b349-457b80e09fd9 req-defb76be-cba4-419d-9606-3f539744080f service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:01.148626 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3a41562e-a73d-496b-b349-457b80e09fd9 req-defb76be-cba4-419d-9606-3f539744080f service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:01.161160 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-3a41562e-a73d-496b-b349-457b80e09fd9 req-defb76be-cba4-419d-9606-3f539744080f service nova] Creating event network-vif-plugged:5018bca9-d0fd-4019-a69a-d25003f4d4da for instance c04fcc98-6f6b-4092-ba63-364498327bb6 on hv-cinder-86155 Oct 17 04:37:01.166281 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-3a41562e-a73d-496b-b349-457b80e09fd9 req-defb76be-cba4-419d-9606-3f539744080f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066876 Oct 17 04:37:01.167320 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 348/685] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:37:01.475399 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-857e73ab-2712-465b-8c1a-efa3c079ef08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:01.476337 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-857e73ab-2712-465b-8c1a-efa3c079ef08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:01.485211 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-857e73ab-2712-465b-8c1a-efa3c079ef08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:01.485764 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-857e73ab-2712-465b-8c1a-efa3c079ef08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:01.486210 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-857e73ab-2712-465b-8c1a-efa3c079ef08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:01.486921 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-857e73ab-2712-465b-8c1a-efa3c079ef08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:01.487454 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-857e73ab-2712-465b-8c1a-efa3c079ef08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:01.488004 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-857e73ab-2712-465b-8c1a-efa3c079ef08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:01.649516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-857e73ab-2712-465b-8c1a-efa3c079ef08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:01.663616 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-857e73ab-2712-465b-8c1a-efa3c079ef08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:01.665119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-857e73ab-2712-465b-8c1a-efa3c079ef08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:01.666285 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-857e73ab-2712-465b-8c1a-efa3c079ef08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1737 microversion: 2.20 time: 0.195167 Oct 17 04:37:01.666882 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 338/686] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:01 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:01.929399 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebf85e15-afac-46b9-b735-7efb205beeaf tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:01.930218 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ebf85e15-afac-46b9-b735-7efb205beeaf tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:01.938511 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebf85e15-afac-46b9-b735-7efb205beeaf tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:01.939299 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebf85e15-afac-46b9-b735-7efb205beeaf tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:01.939937 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebf85e15-afac-46b9-b735-7efb205beeaf tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:01.940676 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebf85e15-afac-46b9-b735-7efb205beeaf tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:01.941281 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebf85e15-afac-46b9-b735-7efb205beeaf tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:01.941711 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebf85e15-afac-46b9-b735-7efb205beeaf tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:02.086285 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-ebf85e15-afac-46b9-b735-7efb205beeaf tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:02.095139 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ebf85e15-afac-46b9-b735-7efb205beeaf tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1574 microversion: 2.1 time: 0.170059 Oct 17 04:37:02.109507 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 349/687] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:01 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1574 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:02.694600 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e24c3c6b-bde9-441f-a9fd-40759279815d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:02.695222 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e24c3c6b-bde9-441f-a9fd-40759279815d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:02.702088 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e24c3c6b-bde9-441f-a9fd-40759279815d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:02.702975 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e24c3c6b-bde9-441f-a9fd-40759279815d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:02.703413 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e24c3c6b-bde9-441f-a9fd-40759279815d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:02.704111 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e24c3c6b-bde9-441f-a9fd-40759279815d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:02.704649 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e24c3c6b-bde9-441f-a9fd-40759279815d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:02.705095 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e24c3c6b-bde9-441f-a9fd-40759279815d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:02.864257 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e24c3c6b-bde9-441f-a9fd-40759279815d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:02.876300 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e24c3c6b-bde9-441f-a9fd-40759279815d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:02.877658 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e24c3c6b-bde9-441f-a9fd-40759279815d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:02.878885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e24c3c6b-bde9-441f-a9fd-40759279815d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1737 microversion: 2.20 time: 0.188600 Oct 17 04:37:02.879484 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 339/688] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:02 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1737 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:03.118952 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-df2952dc-dfc3-4e1a-bc3e-84d8cc834277 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:03.119667 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-df2952dc-dfc3-4e1a-bc3e-84d8cc834277 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:03.129425 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6881e0bd-238b-4168-b759-07ef54fbfe5f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:03.130269 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6881e0bd-238b-4168-b759-07ef54fbfe5f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:03.142061 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6881e0bd-238b-4168-b759-07ef54fbfe5f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:03.142332 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df2952dc-dfc3-4e1a-bc3e-84d8cc834277 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:03.142991 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6881e0bd-238b-4168-b759-07ef54fbfe5f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:03.143110 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df2952dc-dfc3-4e1a-bc3e-84d8cc834277 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:03.143681 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df2952dc-dfc3-4e1a-bc3e-84d8cc834277 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:03.143925 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6881e0bd-238b-4168-b759-07ef54fbfe5f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:03.144830 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6881e0bd-238b-4168-b759-07ef54fbfe5f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:03.145065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df2952dc-dfc3-4e1a-bc3e-84d8cc834277 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:03.145687 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6881e0bd-238b-4168-b759-07ef54fbfe5f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:03.145802 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df2952dc-dfc3-4e1a-bc3e-84d8cc834277 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:03.146234 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df2952dc-dfc3-4e1a-bc3e-84d8cc834277 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:03.146624 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6881e0bd-238b-4168-b759-07ef54fbfe5f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:03.290876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-6881e0bd-238b-4168-b759-07ef54fbfe5f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lazy-loading 'services' on Instance uuid 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:37:03.394881 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6881e0bd-238b-4168-b759-07ef54fbfe5f tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5/os-volume_attachments/80aae0fa-78d7-441d-bbcd-499521a0d43c" status: 202 len: 0 microversion: 2.1 time: 0.269253 Oct 17 04:37:03.395716 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 340/689] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Oct 17 04:37:03 2022] DELETE /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5/os-volume_attachments/80aae0fa-78d7-441d-bbcd-499521a0d43c => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:37:03.407162 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-264f67f3-b479-47d4-bb8a-5c005d60467d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:03.411623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-df2952dc-dfc3-4e1a-bc3e-84d8cc834277 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:03.418410 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-264f67f3-b479-47d4-bb8a-5c005d60467d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:03.424758 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-264f67f3-b479-47d4-bb8a-5c005d60467d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:03.425285 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-264f67f3-b479-47d4-bb8a-5c005d60467d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:03.425725 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-264f67f3-b479-47d4-bb8a-5c005d60467d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:03.426429 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-264f67f3-b479-47d4-bb8a-5c005d60467d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:03.426565 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-df2952dc-dfc3-4e1a-bc3e-84d8cc834277 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1574 microversion: 2.1 time: 0.310907 Oct 17 04:37:03.427037 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 350/690] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:03 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1574 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:03.445727 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-264f67f3-b479-47d4-bb8a-5c005d60467d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:03.445727 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-264f67f3-b479-47d4-bb8a-5c005d60467d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:03.492125 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-264f67f3-b479-47d4-bb8a-5c005d60467d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089620 Oct 17 04:37:03.497154 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 341/691] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:37:03 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:37:03.912537 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-101a003d-a9dd-4e6f-b99a-eb5d16f48788 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:03.912537 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-101a003d-a9dd-4e6f-b99a-eb5d16f48788 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:03.916335 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-101a003d-a9dd-4e6f-b99a-eb5d16f48788 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:03.916859 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-101a003d-a9dd-4e6f-b99a-eb5d16f48788 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:03.917341 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-101a003d-a9dd-4e6f-b99a-eb5d16f48788 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:03.918062 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-101a003d-a9dd-4e6f-b99a-eb5d16f48788 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:03.918509 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-101a003d-a9dd-4e6f-b99a-eb5d16f48788 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:03.918928 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-101a003d-a9dd-4e6f-b99a-eb5d16f48788 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:04.066293 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-101a003d-a9dd-4e6f-b99a-eb5d16f48788 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:04.074884 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-101a003d-a9dd-4e6f-b99a-eb5d16f48788 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:04.076412 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-101a003d-a9dd-4e6f-b99a-eb5d16f48788 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:04.078919 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-101a003d-a9dd-4e6f-b99a-eb5d16f48788 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1737 microversion: 2.20 time: 0.174713 Oct 17 04:37:04.088118 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 351/692] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:03 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:04.434517 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c9025fcc-024f-4266-90bd-73d1806f03e0 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:04.435068 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c9025fcc-024f-4266-90bd-73d1806f03e0 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:04.442557 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9025fcc-024f-4266-90bd-73d1806f03e0 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:04.443138 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9025fcc-024f-4266-90bd-73d1806f03e0 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:04.443591 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9025fcc-024f-4266-90bd-73d1806f03e0 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:04.444850 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9025fcc-024f-4266-90bd-73d1806f03e0 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:04.446147 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9025fcc-024f-4266-90bd-73d1806f03e0 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:04.446622 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c9025fcc-024f-4266-90bd-73d1806f03e0 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:04.455582 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-83cd86d3-45a5-4697-8405-31ba5500e9ec tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:04.456235 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-83cd86d3-45a5-4697-8405-31ba5500e9ec tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:04.464060 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83cd86d3-45a5-4697-8405-31ba5500e9ec tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:04.464732 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83cd86d3-45a5-4697-8405-31ba5500e9ec tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:04.478742 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83cd86d3-45a5-4697-8405-31ba5500e9ec tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:04.481477 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83cd86d3-45a5-4697-8405-31ba5500e9ec tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:04.482234 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83cd86d3-45a5-4697-8405-31ba5500e9ec tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:04.485047 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-83cd86d3-45a5-4697-8405-31ba5500e9ec tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:04.519781 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c9025fcc-024f-4266-90bd-73d1806f03e0 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments/5b8eeaa5-bf4f-42b9-bf93-348339386f37" status: 200 len: 194 microversion: 2.1 time: 0.089132 Oct 17 04:37:04.520405 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 342/693] 10.222.0.40 () {58 vars in 1413 bytes} [Mon Oct 17 04:37:04 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments/5b8eeaa5-bf4f-42b9-bf93-348339386f37 => generated 194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:37:04.525220 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ea89362b-cb0f-48cd-8d02-66d459f38000 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:04.528432 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ea89362b-cb0f-48cd-8d02-66d459f38000 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:04.535916 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea89362b-cb0f-48cd-8d02-66d459f38000 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:04.537317 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea89362b-cb0f-48cd-8d02-66d459f38000 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:04.538881 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea89362b-cb0f-48cd-8d02-66d459f38000 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:04.540513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea89362b-cb0f-48cd-8d02-66d459f38000 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:04.541173 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea89362b-cb0f-48cd-8d02-66d459f38000 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:04.541781 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ea89362b-cb0f-48cd-8d02-66d459f38000 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:04.583062 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ea89362b-cb0f-48cd-8d02-66d459f38000 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061305 Oct 17 04:37:04.583690 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 343/694] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:37:04 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:37:04.590360 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-41515e3d-c413-4a39-9ad8-51135989a054 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:04.591011 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-41515e3d-c413-4a39-9ad8-51135989a054 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:04.601759 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41515e3d-c413-4a39-9ad8-51135989a054 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:04.602514 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41515e3d-c413-4a39-9ad8-51135989a054 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:04.603152 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41515e3d-c413-4a39-9ad8-51135989a054 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:04.604023 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41515e3d-c413-4a39-9ad8-51135989a054 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:04.604639 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41515e3d-c413-4a39-9ad8-51135989a054 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:04.605362 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-41515e3d-c413-4a39-9ad8-51135989a054 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:04.694787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-83cd86d3-45a5-4697-8405-31ba5500e9ec tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:04.705877 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-83cd86d3-45a5-4697-8405-31ba5500e9ec tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1561 microversion: 2.1 time: 0.255024 Oct 17 04:37:04.706472 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 352/695] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:04 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1561 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:37:04.754258 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-41515e3d-c413-4a39-9ad8-51135989a054 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lazy-loading 'services' on Instance uuid 8fb709e6-ba7f-4703-8f7f-365c33a1c79c {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:37:04.862772 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-41515e3d-c413-4a39-9ad8-51135989a054 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments/5b8eeaa5-bf4f-42b9-bf93-348339386f37" status: 202 len: 0 microversion: 2.1 time: 0.277490 Oct 17 04:37:04.863688 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 344/696] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Oct 17 04:37:04 2022] DELETE /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments/5b8eeaa5-bf4f-42b9-bf93-348339386f37 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:37:05.104345 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-474d5efb-199d-4fd0-ade4-73b8ee025a27 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:05.105123 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-474d5efb-199d-4fd0-ade4-73b8ee025a27 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:05.111332 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-474d5efb-199d-4fd0-ade4-73b8ee025a27 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:05.111823 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-474d5efb-199d-4fd0-ade4-73b8ee025a27 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:05.112280 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-474d5efb-199d-4fd0-ade4-73b8ee025a27 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:05.113275 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-474d5efb-199d-4fd0-ade4-73b8ee025a27 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:05.113733 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-474d5efb-199d-4fd0-ade4-73b8ee025a27 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:05.114292 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-474d5efb-199d-4fd0-ade4-73b8ee025a27 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:05.264059 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-474d5efb-199d-4fd0-ade4-73b8ee025a27 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:05.272782 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-474d5efb-199d-4fd0-ade4-73b8ee025a27 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:05.274256 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-474d5efb-199d-4fd0-ade4-73b8ee025a27 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:05.275405 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-474d5efb-199d-4fd0-ade4-73b8ee025a27 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1737 microversion: 2.20 time: 0.175453 Oct 17 04:37:05.275958 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 353/697] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:05 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:05.599486 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-233bd582-26e9-42bb-8c27-dfa81d722e76 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:05.604641 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-233bd582-26e9-42bb-8c27-dfa81d722e76 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:05.618987 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-233bd582-26e9-42bb-8c27-dfa81d722e76 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:05.619830 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-233bd582-26e9-42bb-8c27-dfa81d722e76 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:05.621311 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-233bd582-26e9-42bb-8c27-dfa81d722e76 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:05.622191 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-233bd582-26e9-42bb-8c27-dfa81d722e76 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:05.622811 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-233bd582-26e9-42bb-8c27-dfa81d722e76 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:05.623401 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-233bd582-26e9-42bb-8c27-dfa81d722e76 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:05.664516 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-233bd582-26e9-42bb-8c27-dfa81d722e76 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072744 Oct 17 04:37:05.668686 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 345/698] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:37:05 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 04:37:05.752301 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9561b1ed-5884-417b-9a3f-24cc0540a72c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:05.753549 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9561b1ed-5884-417b-9a3f-24cc0540a72c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:05.763879 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9561b1ed-5884-417b-9a3f-24cc0540a72c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:05.765393 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9561b1ed-5884-417b-9a3f-24cc0540a72c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:05.766095 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9561b1ed-5884-417b-9a3f-24cc0540a72c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:05.766872 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9561b1ed-5884-417b-9a3f-24cc0540a72c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:05.767498 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9561b1ed-5884-417b-9a3f-24cc0540a72c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:05.767927 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-9561b1ed-5884-417b-9a3f-24cc0540a72c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:05.798740 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-9561b1ed-5884-417b-9a3f-24cc0540a72c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:37:05.917382 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9561b1ed-5884-417b-9a3f-24cc0540a72c tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 204 len: 0 microversion: 2.1 time: 0.168630 Oct 17 04:37:05.917886 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 354/699] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:37:05 2022] DELETE /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:37:05.926918 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-21d0aea3-7a9c-4115-9b71-7336f31ddcd1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:05.927808 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-21d0aea3-7a9c-4115-9b71-7336f31ddcd1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:05.938523 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21d0aea3-7a9c-4115-9b71-7336f31ddcd1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:05.939031 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21d0aea3-7a9c-4115-9b71-7336f31ddcd1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:05.939470 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21d0aea3-7a9c-4115-9b71-7336f31ddcd1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:05.943227 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21d0aea3-7a9c-4115-9b71-7336f31ddcd1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:05.944129 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21d0aea3-7a9c-4115-9b71-7336f31ddcd1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:05.944569 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-21d0aea3-7a9c-4115-9b71-7336f31ddcd1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:05.966654 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:37:06.080027 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-35317d8b-203f-4749-96fa-0910769d8e20 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:06.082565 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-35317d8b-203f-4749-96fa-0910769d8e20 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:06.089092 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35317d8b-203f-4749-96fa-0910769d8e20 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:06.089642 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35317d8b-203f-4749-96fa-0910769d8e20 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:06.090084 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35317d8b-203f-4749-96fa-0910769d8e20 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:06.090798 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35317d8b-203f-4749-96fa-0910769d8e20 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:06.091255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35317d8b-203f-4749-96fa-0910769d8e20 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:06.091688 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35317d8b-203f-4749-96fa-0910769d8e20 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:06.133116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-35317d8b-203f-4749-96fa-0910769d8e20 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057089 Oct 17 04:37:06.133116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 355/700] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:37:06 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:37:06.149325 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-21d0aea3-7a9c-4115-9b71-7336f31ddcd1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:06.158216 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-21d0aea3-7a9c-4115-9b71-7336f31ddcd1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 200 len: 1681 microversion: 2.1 time: 0.235144 Oct 17 04:37:06.169170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 346/701] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:05 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 1681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:06.302273 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f4e227af-22cc-48bc-bfe6-758be9199bde tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:06.303222 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f4e227af-22cc-48bc-bfe6-758be9199bde tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:06.309952 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4e227af-22cc-48bc-bfe6-758be9199bde tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:06.310651 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4e227af-22cc-48bc-bfe6-758be9199bde tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:06.311168 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4e227af-22cc-48bc-bfe6-758be9199bde tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:06.312757 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4e227af-22cc-48bc-bfe6-758be9199bde tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:06.313283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4e227af-22cc-48bc-bfe6-758be9199bde tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:06.313784 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f4e227af-22cc-48bc-bfe6-758be9199bde tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:06.464653 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f4e227af-22cc-48bc-bfe6-758be9199bde tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:06.478300 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f4e227af-22cc-48bc-bfe6-758be9199bde tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:06.479857 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f4e227af-22cc-48bc-bfe6-758be9199bde tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:06.481056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f4e227af-22cc-48bc-bfe6-758be9199bde tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1737 microversion: 2.20 time: 0.183208 Oct 17 04:37:06.484750 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 356/702] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:06 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:07.144647 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d4e9cac3-1992-416d-ba74-4bfa7c995699 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:07.147625 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d4e9cac3-1992-416d-ba74-4bfa7c995699 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:07.154942 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4e9cac3-1992-416d-ba74-4bfa7c995699 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:07.156269 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4e9cac3-1992-416d-ba74-4bfa7c995699 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:07.156887 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4e9cac3-1992-416d-ba74-4bfa7c995699 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:07.157621 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4e9cac3-1992-416d-ba74-4bfa7c995699 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:07.158082 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4e9cac3-1992-416d-ba74-4bfa7c995699 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:07.158510 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d4e9cac3-1992-416d-ba74-4bfa7c995699 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:07.184836 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-21d73f92-54e0-49df-aa33-5408d1858033 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:07.185551 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-21d73f92-54e0-49df-aa33-5408d1858033 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:07.190107 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d4e9cac3-1992-416d-ba74-4bfa7c995699 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049419 Oct 17 04:37:07.194137 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21d73f92-54e0-49df-aa33-5408d1858033 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:07.194621 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21d73f92-54e0-49df-aa33-5408d1858033 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:07.195067 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 347/703] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:37:07 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:37:07.195199 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21d73f92-54e0-49df-aa33-5408d1858033 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:07.195839 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21d73f92-54e0-49df-aa33-5408d1858033 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:07.196319 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21d73f92-54e0-49df-aa33-5408d1858033 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:07.196787 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-21d73f92-54e0-49df-aa33-5408d1858033 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:07.367262 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-21d73f92-54e0-49df-aa33-5408d1858033 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:07.375578 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-21d73f92-54e0-49df-aa33-5408d1858033 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 200 len: 1681 microversion: 2.1 time: 0.195507 Oct 17 04:37:07.377148 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 357/704] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:07 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 1681 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:07.514151 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-09ae4bb4-53c4-478f-9e8d-37a236418c07 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:07.515725 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-09ae4bb4-53c4-478f-9e8d-37a236418c07 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:07.523510 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09ae4bb4-53c4-478f-9e8d-37a236418c07 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:07.524029 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09ae4bb4-53c4-478f-9e8d-37a236418c07 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:07.524479 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09ae4bb4-53c4-478f-9e8d-37a236418c07 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:07.525241 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09ae4bb4-53c4-478f-9e8d-37a236418c07 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:07.526221 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09ae4bb4-53c4-478f-9e8d-37a236418c07 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:07.526221 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-09ae4bb4-53c4-478f-9e8d-37a236418c07 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:07.673658 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-09ae4bb4-53c4-478f-9e8d-37a236418c07 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:07.683835 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-09ae4bb4-53c4-478f-9e8d-37a236418c07 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:07.685579 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-09ae4bb4-53c4-478f-9e8d-37a236418c07 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:07.687132 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-09ae4bb4-53c4-478f-9e8d-37a236418c07 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1737 microversion: 2.20 time: 0.177049 Oct 17 04:37:07.687683 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 348/705] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:07 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:08.203350 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6abee0de-e51e-44e4-bce3-1e29689a85e6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:08.205616 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6abee0de-e51e-44e4-bce3-1e29689a85e6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:08.212210 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6abee0de-e51e-44e4-bce3-1e29689a85e6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:08.212692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6abee0de-e51e-44e4-bce3-1e29689a85e6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:08.213157 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6abee0de-e51e-44e4-bce3-1e29689a85e6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:08.213852 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6abee0de-e51e-44e4-bce3-1e29689a85e6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:08.214308 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6abee0de-e51e-44e4-bce3-1e29689a85e6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:08.214730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6abee0de-e51e-44e4-bce3-1e29689a85e6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:08.243849 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6abee0de-e51e-44e4-bce3-1e29689a85e6 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045487 Oct 17 04:37:08.244417 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 358/706] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:37:08 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 04:37:08.362769 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-05f7e02c-a2f6-4364-802b-c0e1c48193db tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:08.364918 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-05f7e02c-a2f6-4364-802b-c0e1c48193db tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:08.391291 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05f7e02c-a2f6-4364-802b-c0e1c48193db tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:08.391791 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05f7e02c-a2f6-4364-802b-c0e1c48193db tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:08.392409 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05f7e02c-a2f6-4364-802b-c0e1c48193db tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:08.393354 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05f7e02c-a2f6-4364-802b-c0e1c48193db tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:08.395296 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05f7e02c-a2f6-4364-802b-c0e1c48193db tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:08.395777 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05f7e02c-a2f6-4364-802b-c0e1c48193db tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:08.399873 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-546e21eb-6ef2-4481-84e3-02d5c7761943 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:08.400785 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-546e21eb-6ef2-4481-84e3-02d5c7761943 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:08.409065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-546e21eb-6ef2-4481-84e3-02d5c7761943 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:08.410153 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-546e21eb-6ef2-4481-84e3-02d5c7761943 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:08.410824 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-546e21eb-6ef2-4481-84e3-02d5c7761943 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:08.412020 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-546e21eb-6ef2-4481-84e3-02d5c7761943 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:08.414021 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-546e21eb-6ef2-4481-84e3-02d5c7761943 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:08.414696 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-546e21eb-6ef2-4481-84e3-02d5c7761943 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:08.463207 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-05f7e02c-a2f6-4364-802b-c0e1c48193db tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104290 Oct 17 04:37:08.470455 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 349/707] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:37:08 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 04:37:08.533814 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-546e21eb-6ef2-4481-84e3-02d5c7761943 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:08.533814 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-546e21eb-6ef2-4481-84e3-02d5c7761943 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 200 len: 1614 microversion: 2.1 time: 0.134349 Oct 17 04:37:08.533814 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 359/708] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:08 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 1614 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:08.542404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff1fc7af-8f21-42bc-9eb8-675eb2400378 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:08.543110 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff1fc7af-8f21-42bc-9eb8-675eb2400378 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:08.550197 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff1fc7af-8f21-42bc-9eb8-675eb2400378 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:08.551100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff1fc7af-8f21-42bc-9eb8-675eb2400378 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:08.551699 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff1fc7af-8f21-42bc-9eb8-675eb2400378 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:08.552577 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff1fc7af-8f21-42bc-9eb8-675eb2400378 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:08.553211 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff1fc7af-8f21-42bc-9eb8-675eb2400378 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:08.553785 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff1fc7af-8f21-42bc-9eb8-675eb2400378 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:08.579082 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:37:08.593375 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff1fc7af-8f21-42bc-9eb8-675eb2400378 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:37:08.722984 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff1fc7af-8f21-42bc-9eb8-675eb2400378 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 204 len: 0 microversion: 2.1 time: 0.184649 Oct 17 04:37:08.724293 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 360/709] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:37:08 2022] DELETE /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:37:08.732018 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ff5b5a05-601b-4da3-9fb8-9c3c8e806bff tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:08.733595 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ff5b5a05-601b-4da3-9fb8-9c3c8e806bff tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:08.743296 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff5b5a05-601b-4da3-9fb8-9c3c8e806bff tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:08.745452 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff5b5a05-601b-4da3-9fb8-9c3c8e806bff tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:08.745898 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff5b5a05-601b-4da3-9fb8-9c3c8e806bff tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:08.746611 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff5b5a05-601b-4da3-9fb8-9c3c8e806bff tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:08.747127 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff5b5a05-601b-4da3-9fb8-9c3c8e806bff tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:08.748142 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ff5b5a05-601b-4da3-9fb8-9c3c8e806bff tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:08.766440 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-7e5fd743-6d9a-421e-9993-654c2c763f11 req-08eda81c-629b-4eaa-8087-1dea5e835bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cdbf4e7-ae88-4e26-a40b-cbd881612fe5", "name": "network-vif-deleted", "tag": "1d5c5bce-a6c7-4bf9-a814-b29960fc6306"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:37:08.776691 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7e5fd743-6d9a-421e-9993-654c2c763f11 req-08eda81c-629b-4eaa-8087-1dea5e835bc8 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:08.777205 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7e5fd743-6d9a-421e-9993-654c2c763f11 req-08eda81c-629b-4eaa-8087-1dea5e835bc8 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:08.777657 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-7e5fd743-6d9a-421e-9993-654c2c763f11 req-08eda81c-629b-4eaa-8087-1dea5e835bc8 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:08.790517 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-7e5fd743-6d9a-421e-9993-654c2c763f11 req-08eda81c-629b-4eaa-8087-1dea5e835bc8 service nova] Creating event network-vif-deleted:1d5c5bce-a6c7-4bf9-a814-b29960fc6306 for instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 on hv-cinder-86155 Oct 17 04:37:08.796231 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-7e5fd743-6d9a-421e-9993-654c2c763f11 req-08eda81c-629b-4eaa-8087-1dea5e835bc8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.323701 Oct 17 04:37:08.796835 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 350/710] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:37:08.803588 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4ab3e711-17e7-4eb8-8240-22d44127ac71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:08.804618 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4ab3e711-17e7-4eb8-8240-22d44127ac71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:08.810794 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ab3e711-17e7-4eb8-8240-22d44127ac71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:08.811442 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ab3e711-17e7-4eb8-8240-22d44127ac71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:08.811940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ab3e711-17e7-4eb8-8240-22d44127ac71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:08.812653 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ab3e711-17e7-4eb8-8240-22d44127ac71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:08.813131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ab3e711-17e7-4eb8-8240-22d44127ac71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:08.813560 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4ab3e711-17e7-4eb8-8240-22d44127ac71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:08.954502 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff5b5a05-601b-4da3-9fb8-9c3c8e806bff tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:08.963354 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff5b5a05-601b-4da3-9fb8-9c3c8e806bff tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:08.964902 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-ff5b5a05-601b-4da3-9fb8-9c3c8e806bff tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:08.966183 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ff5b5a05-601b-4da3-9fb8-9c3c8e806bff tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1719 microversion: 2.20 time: 0.240333 Oct 17 04:37:08.967011 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 361/711] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:08 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1719 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:08.984470 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-4ab3e711-17e7-4eb8-8240-22d44127ac71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:08.992487 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4ab3e711-17e7-4eb8-8240-22d44127ac71 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 200 len: 1673 microversion: 2.1 time: 0.194331 Oct 17 04:37:08.993193 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 351/712] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:08 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 1673 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:09.558481 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7b1e9d95-2a45-4acc-8152-e40349a60dee tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:09.559097 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7b1e9d95-2a45-4acc-8152-e40349a60dee tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:09.566163 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b1e9d95-2a45-4acc-8152-e40349a60dee tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:09.566644 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b1e9d95-2a45-4acc-8152-e40349a60dee tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:09.567081 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b1e9d95-2a45-4acc-8152-e40349a60dee tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:09.567775 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b1e9d95-2a45-4acc-8152-e40349a60dee tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:09.568227 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b1e9d95-2a45-4acc-8152-e40349a60dee tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:09.568648 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b1e9d95-2a45-4acc-8152-e40349a60dee tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:09.599702 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b1e9d95-2a45-4acc-8152-e40349a60dee tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:09.600172 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b1e9d95-2a45-4acc-8152-e40349a60dee tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:09.600769 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7b1e9d95-2a45-4acc-8152-e40349a60dee tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:09.601240 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-7b1e9d95-2a45-4acc-8152-e40349a60dee tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lazy-loading 'fault' on Instance uuid 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:37:09.641776 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-7b1e9d95-2a45-4acc-8152-e40349a60dee tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:09.649346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7b1e9d95-2a45-4acc-8152-e40349a60dee tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 200 len: 1331 microversion: 2.1 time: 0.094833 Oct 17 04:37:09.649903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 362/713] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:09 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:09.993386 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ce846fa1-315c-4ba3-994f-88a0b35f8048 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:09.994001 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ce846fa1-315c-4ba3-994f-88a0b35f8048 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:10.001113 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce846fa1-315c-4ba3-994f-88a0b35f8048 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:10.001597 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce846fa1-315c-4ba3-994f-88a0b35f8048 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:10.002033 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce846fa1-315c-4ba3-994f-88a0b35f8048 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:10.002721 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce846fa1-315c-4ba3-994f-88a0b35f8048 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:10.003172 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce846fa1-315c-4ba3-994f-88a0b35f8048 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:10.003594 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce846fa1-315c-4ba3-994f-88a0b35f8048 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:10.016362 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a4ee98ad-3cc8-438e-aa02-8019a903b1c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:10.016968 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a4ee98ad-3cc8-438e-aa02-8019a903b1c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:10.022790 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4ee98ad-3cc8-438e-aa02-8019a903b1c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:10.023266 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4ee98ad-3cc8-438e-aa02-8019a903b1c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:10.023697 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4ee98ad-3cc8-438e-aa02-8019a903b1c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:10.024376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4ee98ad-3cc8-438e-aa02-8019a903b1c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:10.024825 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4ee98ad-3cc8-438e-aa02-8019a903b1c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:10.025278 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a4ee98ad-3cc8-438e-aa02-8019a903b1c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:10.196626 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-ce846fa1-315c-4ba3-994f-88a0b35f8048 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:10.206014 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-ce846fa1-315c-4ba3-994f-88a0b35f8048 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:10.207715 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-ce846fa1-315c-4ba3-994f-88a0b35f8048 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:10.208917 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ce846fa1-315c-4ba3-994f-88a0b35f8048 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1719 microversion: 2.20 time: 0.219460 Oct 17 04:37:10.214360 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a4ee98ad-3cc8-438e-aa02-8019a903b1c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:10.221581 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 352/714] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:09 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1719 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:10.222860 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a4ee98ad-3cc8-438e-aa02-8019a903b1c8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 200 len: 1673 microversion: 2.1 time: 0.210854 Oct 17 04:37:10.223419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 363/715] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:10 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 1673 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:37:10.672902 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-be0e0691-e640-41f0-8b2f-25782c7e894d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:10.673461 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-be0e0691-e640-41f0-8b2f-25782c7e894d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:10.679694 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be0e0691-e640-41f0-8b2f-25782c7e894d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:10.680176 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be0e0691-e640-41f0-8b2f-25782c7e894d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:10.680608 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be0e0691-e640-41f0-8b2f-25782c7e894d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:10.681323 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be0e0691-e640-41f0-8b2f-25782c7e894d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:10.681771 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be0e0691-e640-41f0-8b2f-25782c7e894d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:10.682190 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be0e0691-e640-41f0-8b2f-25782c7e894d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:10.711863 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be0e0691-e640-41f0-8b2f-25782c7e894d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:10.712332 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be0e0691-e640-41f0-8b2f-25782c7e894d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:10.712757 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-be0e0691-e640-41f0-8b2f-25782c7e894d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:10.713216 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-be0e0691-e640-41f0-8b2f-25782c7e894d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lazy-loading 'fault' on Instance uuid 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:37:10.752500 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-be0e0691-e640-41f0-8b2f-25782c7e894d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:10.760010 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-be0e0691-e640-41f0-8b2f-25782c7e894d tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 200 len: 1331 microversion: 2.1 time: 0.091844 Oct 17 04:37:10.760575 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 353/716] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:10 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 1331 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:11.012445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-bc8bf171-001f-42ff-a16b-aa76f0c915d2 req-d7b9a72c-bd68-4540-9b6e-03034a766c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58170c9-886a-45c1-9c0e-acfb37fab782", "name": "network-vif-unplugged", "status": "completed", "tag": "0c4b79b8-f091-4221-b5d8-ad21adc83468"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:37:11.023365 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-bc8bf171-001f-42ff-a16b-aa76f0c915d2 req-d7b9a72c-bd68-4540-9b6e-03034a766c5f service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:11.023843 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-bc8bf171-001f-42ff-a16b-aa76f0c915d2 req-d7b9a72c-bd68-4540-9b6e-03034a766c5f service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:11.024289 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-bc8bf171-001f-42ff-a16b-aa76f0c915d2 req-d7b9a72c-bd68-4540-9b6e-03034a766c5f service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:11.036245 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-bc8bf171-001f-42ff-a16b-aa76f0c915d2 req-d7b9a72c-bd68-4540-9b6e-03034a766c5f service nova] Creating event network-vif-unplugged:0c4b79b8-f091-4221-b5d8-ad21adc83468 for instance e58170c9-886a-45c1-9c0e-acfb37fab782 on hv-cinder-86155 Oct 17 04:37:11.040979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-bc8bf171-001f-42ff-a16b-aa76f0c915d2 req-d7b9a72c-bd68-4540-9b6e-03034a766c5f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032208 Oct 17 04:37:11.041768 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 364/717] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:37:11.234247 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bcc935c1-d6b9-4f21-8295-29f8beec5f3e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:11.234788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bcc935c1-d6b9-4f21-8295-29f8beec5f3e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:11.241177 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bcc935c1-d6b9-4f21-8295-29f8beec5f3e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:11.241657 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bcc935c1-d6b9-4f21-8295-29f8beec5f3e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:11.242091 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bcc935c1-d6b9-4f21-8295-29f8beec5f3e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:11.242777 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bcc935c1-d6b9-4f21-8295-29f8beec5f3e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:11.243224 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bcc935c1-d6b9-4f21-8295-29f8beec5f3e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:11.243644 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bcc935c1-d6b9-4f21-8295-29f8beec5f3e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:11.246243 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5d76b2e2-f2a1-4165-99dc-bfde385f2f18 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:11.246941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5d76b2e2-f2a1-4165-99dc-bfde385f2f18 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:11.253575 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d76b2e2-f2a1-4165-99dc-bfde385f2f18 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:11.254097 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d76b2e2-f2a1-4165-99dc-bfde385f2f18 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:11.254531 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d76b2e2-f2a1-4165-99dc-bfde385f2f18 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:11.255223 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d76b2e2-f2a1-4165-99dc-bfde385f2f18 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:11.255683 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d76b2e2-f2a1-4165-99dc-bfde385f2f18 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:11.256102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5d76b2e2-f2a1-4165-99dc-bfde385f2f18 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:11.439243 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-bcc935c1-d6b9-4f21-8295-29f8beec5f3e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:11.442282 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5d76b2e2-f2a1-4165-99dc-bfde385f2f18 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:11.447338 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-bcc935c1-d6b9-4f21-8295-29f8beec5f3e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:11.448772 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-bcc935c1-d6b9-4f21-8295-29f8beec5f3e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:11.449898 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5d76b2e2-f2a1-4165-99dc-bfde385f2f18 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 200 len: 1673 microversion: 2.1 time: 0.207798 Oct 17 04:37:11.450021 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bcc935c1-d6b9-4f21-8295-29f8beec5f3e tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1719 microversion: 2.20 time: 0.220104 Oct 17 04:37:11.450730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 365/719] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:11 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 1673 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:37:11.450862 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 354/719] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:11 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1719 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:11.782368 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f014a8a4-462d-42fc-9ceb-2b9790f6e145 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:11.782988 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f014a8a4-462d-42fc-9ceb-2b9790f6e145 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:11.788888 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f014a8a4-462d-42fc-9ceb-2b9790f6e145 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:11.789405 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f014a8a4-462d-42fc-9ceb-2b9790f6e145 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:11.789851 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f014a8a4-462d-42fc-9ceb-2b9790f6e145 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:11.790527 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f014a8a4-462d-42fc-9ceb-2b9790f6e145 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:11.790978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f014a8a4-462d-42fc-9ceb-2b9790f6e145 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:11.791402 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f014a8a4-462d-42fc-9ceb-2b9790f6e145 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:11.822949 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f014a8a4-462d-42fc-9ceb-2b9790f6e145 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:11.823419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f014a8a4-462d-42fc-9ceb-2b9790f6e145 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:11.823842 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f014a8a4-462d-42fc-9ceb-2b9790f6e145 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:11.824275 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-f014a8a4-462d-42fc-9ceb-2b9790f6e145 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lazy-loading 'fault' on Instance uuid 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:37:11.867508 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f014a8a4-462d-42fc-9ceb-2b9790f6e145 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59aa96241a8e4d9db6d255c38f618ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e022e6125e85417881ce226db7a5c764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:11.876439 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f014a8a4-462d-42fc-9ceb-2b9790f6e145 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 200 len: 1331 microversion: 2.1 time: 0.097927 Oct 17 04:37:11.876989 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 366/720] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:11 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:12.491863 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e2d0aaaa-f9ad-4a67-9dfd-3e236fc98403 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:12.493978 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-67acb007-de13-48c7-a0ba-e07552efe0f8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:12.496948 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-67acb007-de13-48c7-a0ba-e07552efe0f8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:12.498068 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e2d0aaaa-f9ad-4a67-9dfd-3e236fc98403 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:12.512204 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67acb007-de13-48c7-a0ba-e07552efe0f8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:12.512703 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67acb007-de13-48c7-a0ba-e07552efe0f8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:12.513248 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67acb007-de13-48c7-a0ba-e07552efe0f8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:12.513859 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67acb007-de13-48c7-a0ba-e07552efe0f8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:12.514541 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67acb007-de13-48c7-a0ba-e07552efe0f8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:12.515183 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67acb007-de13-48c7-a0ba-e07552efe0f8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:12.519832 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2d0aaaa-f9ad-4a67-9dfd-3e236fc98403 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:12.520374 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2d0aaaa-f9ad-4a67-9dfd-3e236fc98403 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:12.520801 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2d0aaaa-f9ad-4a67-9dfd-3e236fc98403 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:12.522138 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2d0aaaa-f9ad-4a67-9dfd-3e236fc98403 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:12.522586 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2d0aaaa-f9ad-4a67-9dfd-3e236fc98403 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:12.523007 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2d0aaaa-f9ad-4a67-9dfd-3e236fc98403 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:12.615280 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-67acb007-de13-48c7-a0ba-e07552efe0f8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:12.623212 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-67acb007-de13-48c7-a0ba-e07552efe0f8 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 200 len: 1606 microversion: 2.1 time: 0.149009 Oct 17 04:37:12.624499 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 355/721] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:12 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 1606 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:12.682056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e2d0aaaa-f9ad-4a67-9dfd-3e236fc98403 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:12.690804 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e2d0aaaa-f9ad-4a67-9dfd-3e236fc98403 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:12.692244 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e2d0aaaa-f9ad-4a67-9dfd-3e236fc98403 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:12.693452 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e2d0aaaa-f9ad-4a67-9dfd-3e236fc98403 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1662 microversion: 2.20 time: 0.220003 Oct 17 04:37:12.693991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 367/722] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:12 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1662 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:12.719535 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b0a33955-6fac-4eb7-a79a-934976ec8f08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bff487f6-2a28-4db5-a6d4-e3c6bd4a95c7"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:37:12.722063 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b0a33955-6fac-4eb7-a79a-934976ec8f08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:12.728024 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0a33955-6fac-4eb7-a79a-934976ec8f08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:12.728581 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0a33955-6fac-4eb7-a79a-934976ec8f08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:12.729116 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0a33955-6fac-4eb7-a79a-934976ec8f08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:12.729908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0a33955-6fac-4eb7-a79a-934976ec8f08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:12.730434 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0a33955-6fac-4eb7-a79a-934976ec8f08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:12.730941 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b0a33955-6fac-4eb7-a79a-934976ec8f08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:12.900321 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bdb5dd30-f0e7-4510-a22c-f7d772756c44 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:12.902088 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bdb5dd30-f0e7-4510-a22c-f7d772756c44 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:12.912791 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bdb5dd30-f0e7-4510-a22c-f7d772756c44 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:12.914030 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bdb5dd30-f0e7-4510-a22c-f7d772756c44 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:12.917004 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bdb5dd30-f0e7-4510-a22c-f7d772756c44 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:12.918113 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bdb5dd30-f0e7-4510-a22c-f7d772756c44 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:12.919056 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bdb5dd30-f0e7-4510-a22c-f7d772756c44 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:12.919703 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bdb5dd30-f0e7-4510-a22c-f7d772756c44 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:12.939289 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-bdb5dd30-f0e7-4510-a22c-f7d772756c44 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] HTTP exception thrown: Instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 could not be found. Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bdb5dd30-f0e7-4510-a22c-f7d772756c44 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Request method failure captured: Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 HTTP/1.1 Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNqRI5416bQSxgt6AXPotC0ZA8EQSE7l65zNcTm_mxUo9wFNmkuLDOKI-_C3Raae9FpamLQxUS44gziCftz35IAzDjSECza3w5spd_jxIdlfyyzXpOJTef9rLRzMW0mp2HVcK15b4ajr4hc5Lz_I9yQNIKfhl18_NwaTHORpu95fjDE Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:37:12.941662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:37:12.943318 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e022e6125e85417881ce226db7a5c764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e022e6125e85417881ce226db7a5c764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:12.943318 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:12.943318 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:37:12.943318 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:12.943318 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:37:12.943318 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:37:12.943318 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:37:12.943318 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 59aa96241a8e4d9db6d255c38f618ca1 Oct 17 04:37:12.943318 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:37:12.943318 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:37:12.943318 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 could not be found. Oct 17 04:37:12.943318 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': '7cdbf4e7-ae88-4e26-a40b-cbd881612fe5'} Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 could not be found. Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:12.944236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:12.945792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:12.945792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:37:12.945792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:37:12.945792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:37:12.945792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:37:12.945792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:37:12.945792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:37:12.945792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 could not be found. Oct 17 04:37:12.945792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:12.945792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:12.945792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:12.945792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:12.945792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:12.945792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:12.945792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:37:12.945792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:37:12.945792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 could not be found. Oct 17 04:37:12.945792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:12.948222 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bdb5dd30-f0e7-4510-a22c-f7d772756c44 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Returning 404 to user: Instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:12.949730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bdb5dd30-f0e7-4510-a22c-f7d772756c44 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 404 len: 111 microversion: 2.1 time: 0.054573 Oct 17 04:37:12.950479 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 368/723] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:12 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 04:37:12.962795 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b7824d76-45dd-4f4c-b068-e3d5ceaed192 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '.version_select at 0x7fc6326320d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:12.985954 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b7824d76-45dd-4f4c-b068-e3d5ceaed192 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1806056836" status: 202 len: 0 microversion: 2.1 time: 0.029239 Oct 17 04:37:12.986677 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 369/724] 10.222.0.40 () {58 vars in 1221 bytes} [Mon Oct 17 04:37:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1806056836 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:37:13.076026 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b0a33955-6fac-4eb7-a79a-934976ec8f08 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "POST /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.360938 Oct 17 04:37:13.083650 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 356/725] 10.222.0.40 () {62 vars in 1364 bytes} [Mon Oct 17 04:37:12 2022] POST /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782/os-volume_attachments => generated 188 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 04:37:13.199497 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-d05f52cd-a63e-48ad-a5b0-3654a9d4b33d req-effa0332-ccc9-45d5-9618-d0b898fd4bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fb709e6-ba7f-4703-8f7f-365c33a1c79c", "name": "network-vif-deleted", "tag": "11b28132-99ac-43b2-87de-94474fddc936"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:37:13.216623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d05f52cd-a63e-48ad-a5b0-3654a9d4b33d req-effa0332-ccc9-45d5-9618-d0b898fd4bd3 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:13.217461 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d05f52cd-a63e-48ad-a5b0-3654a9d4b33d req-effa0332-ccc9-45d5-9618-d0b898fd4bd3 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:13.218229 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-d05f52cd-a63e-48ad-a5b0-3654a9d4b33d req-effa0332-ccc9-45d5-9618-d0b898fd4bd3 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:13.230621 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-d05f52cd-a63e-48ad-a5b0-3654a9d4b33d req-effa0332-ccc9-45d5-9618-d0b898fd4bd3 service nova] Creating event network-vif-deleted:11b28132-99ac-43b2-87de-94474fddc936 for instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c on hv-cinder-86155 Oct 17 04:37:13.244319 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-d05f52cd-a63e-48ad-a5b0-3654a9d4b33d req-effa0332-ccc9-45d5-9618-d0b898fd4bd3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043264 Oct 17 04:37:13.245609 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 370/726] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:37:13.292756 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5cba05ca-2a5b-47ba-bf92-78667550e9f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:13.293537 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5cba05ca-2a5b-47ba-bf92-78667550e9f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:13.300961 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5cba05ca-2a5b-47ba-bf92-78667550e9f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:13.301983 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5cba05ca-2a5b-47ba-bf92-78667550e9f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:13.302733 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5cba05ca-2a5b-47ba-bf92-78667550e9f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:13.303786 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5cba05ca-2a5b-47ba-bf92-78667550e9f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:13.304404 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5cba05ca-2a5b-47ba-bf92-78667550e9f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:13.305330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5cba05ca-2a5b-47ba-bf92-78667550e9f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:13.628331 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5cba05ca-2a5b-47ba-bf92-78667550e9f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782/os-volume_attachments/bff487f6-2a28-4db5-a6d4-e3c6bd4a95c7" status: 202 len: 0 microversion: 2.20 time: 0.339311 Oct 17 04:37:13.629679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 357/727] 10.222.0.40 () {60 vars in 1457 bytes} [Mon Oct 17 04:37:13 2022] DELETE /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782/os-volume_attachments/bff487f6-2a28-4db5-a6d4-e3c6bd4a95c7 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:37:13.650266 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d053cc27-74ca-4bc5-b58c-586923dd23d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:13.651538 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d053cc27-74ca-4bc5-b58c-586923dd23d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:13.658877 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d053cc27-74ca-4bc5-b58c-586923dd23d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:13.659371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d053cc27-74ca-4bc5-b58c-586923dd23d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:13.659993 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d053cc27-74ca-4bc5-b58c-586923dd23d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:13.660863 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d053cc27-74ca-4bc5-b58c-586923dd23d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:13.661742 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d053cc27-74ca-4bc5-b58c-586923dd23d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:13.662190 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d053cc27-74ca-4bc5-b58c-586923dd23d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:13.700590 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-feeec269-e72a-4e3d-94f1-6f36e199fccc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:37:13.701810 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-feeec269-e72a-4e3d-94f1-6f36e199fccc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:13.718025 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-feeec269-e72a-4e3d-94f1-6f36e199fccc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:13.718522 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-feeec269-e72a-4e3d-94f1-6f36e199fccc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:13.718965 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-feeec269-e72a-4e3d-94f1-6f36e199fccc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:13.719669 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-feeec269-e72a-4e3d-94f1-6f36e199fccc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:13.725387 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-feeec269-e72a-4e3d-94f1-6f36e199fccc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:13.730116 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-feeec269-e72a-4e3d-94f1-6f36e199fccc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:13.755576 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:37:13.759545 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d053cc27-74ca-4bc5-b58c-586923dd23d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:13.760044 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d053cc27-74ca-4bc5-b58c-586923dd23d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:13.760530 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d053cc27-74ca-4bc5-b58c-586923dd23d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:13.760984 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-d053cc27-74ca-4bc5-b58c-586923dd23d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lazy-loading 'fault' on Instance uuid 8fb709e6-ba7f-4703-8f7f-365c33a1c79c {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:37:13.925752 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-d053cc27-74ca-4bc5-b58c-586923dd23d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78eac67939a44d0fa99cb748b56f7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de6141e0c3a41bcb84ac635b48a51df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:13.938423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d053cc27-74ca-4bc5-b58c-586923dd23d7 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 200 len: 1328 microversion: 2.1 time: 0.294461 Oct 17 04:37:13.939141 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 371/728] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:13 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 1328 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:14.037644 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-feeec269-e72a-4e3d-94f1-6f36e199fccc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119128) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 04:37:14.121691 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-feeec269-e72a-4e3d-94f1-6f36e199fccc tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "POST /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782/action" status: 202 len: 0 microversion: 2.20 time: 0.424712 Oct 17 04:37:14.127584 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 358/729] 10.222.0.40 () {62 vars in 1319 bytes} [Mon Oct 17 04:37:13 2022] POST /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 04:37:14.131504 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-96409028-6639-4540-8e3d-241faca1feef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:14.132347 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-96409028-6639-4540-8e3d-241faca1feef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:14.141033 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96409028-6639-4540-8e3d-241faca1feef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:14.141549 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96409028-6639-4540-8e3d-241faca1feef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:14.142153 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96409028-6639-4540-8e3d-241faca1feef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:14.143022 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96409028-6639-4540-8e3d-241faca1feef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:14.143635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96409028-6639-4540-8e3d-241faca1feef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:14.144060 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-96409028-6639-4540-8e3d-241faca1feef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:14.322773 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-96409028-6639-4540-8e3d-241faca1feef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:14.332585 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-96409028-6639-4540-8e3d-241faca1feef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:14.334120 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-96409028-6639-4540-8e3d-241faca1feef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:14.336069 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-96409028-6639-4540-8e3d-241faca1feef tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1670 microversion: 2.20 time: 0.208409 Oct 17 04:37:14.336654 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 372/730] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:14 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1670 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:37:14.968311 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-62ce41b2-f234-4486-8f1b-bebbda4673bf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:14.968928 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-62ce41b2-f234-4486-8f1b-bebbda4673bf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:14.975362 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62ce41b2-f234-4486-8f1b-bebbda4673bf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:14.975850 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62ce41b2-f234-4486-8f1b-bebbda4673bf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:14.976287 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62ce41b2-f234-4486-8f1b-bebbda4673bf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:14.976984 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62ce41b2-f234-4486-8f1b-bebbda4673bf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:14.977483 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62ce41b2-f234-4486-8f1b-bebbda4673bf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:14.978026 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-62ce41b2-f234-4486-8f1b-bebbda4673bf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:14.992768 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-62ce41b2-f234-4486-8f1b-bebbda4673bf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] HTTP exception thrown: Instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c could not be found. Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-62ce41b2-f234-4486-8f1b-bebbda4673bf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Request method failure captured: Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c HTTP/1.1 Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNqRUiXt4PHEZM45Sl2dRGKw92wrAMscBJB9ZAwCEDIPH2HxVsoMIKkUKFHPlERhunaUHlnBmKrDLC-749DjsE3-Tz_Ttygz1dTltMlQqDMBzpc2WOagOL29Oy1j5ERZPVQ95iO44jL5tdGPvvwoVWPS8zmeonSpbFiTmRzLyai1Uck Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: 9de6141e0c3a41bcb84ac635b48a51df Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeTestJSON-1936456196 Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:37:14.994630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:37:14.996314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:14.996314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeTestJSON-1936456196 Oct 17 04:37:14.996314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: 9de6141e0c3a41bcb84ac635b48a51df Oct 17 04:37:14.996314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1936456196 Oct 17 04:37:14.996314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-AttachVolumeTestJSON-1936456196-project Oct 17 04:37:14.996314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:37:14.996314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:37:14.996314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: 78eac67939a44d0fa99cb748b56f7b70 Oct 17 04:37:14.996314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeTestJSON-1936456196-project Oct 17 04:37:14.996314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:37:14.996314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c could not be found. Oct 17 04:37:14.996314 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': '8fb709e6-ba7f-4703-8f7f-365c33a1c79c'} Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c could not be found. Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:14.997256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:14.998820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:14.998820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:37:14.998820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:37:14.998820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:37:14.998820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:37:14.998820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:37:14.998820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:37:14.998820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c could not be found. Oct 17 04:37:14.998820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:14.998820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:14.998820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:14.998820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:14.998820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:14.998820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:14.998820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:37:14.998820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:37:14.998820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c could not be found. Oct 17 04:37:14.998820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:15.000874 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-62ce41b2-f234-4486-8f1b-bebbda4673bf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Returning 404 to user: Instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:15.002016 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-62ce41b2-f234-4486-8f1b-bebbda4673bf tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 404 len: 111 microversion: 2.1 time: 0.038624 Oct 17 04:37:15.002578 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 359/731] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:14 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:37:15.011153 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1687ec2c-6b5d-4055-a6b3-7b1fb62a20da tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '.version_select at 0x7fc630c4b5e0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:15.030322 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1687ec2c-6b5d-4055-a6b3-7b1fb62a20da tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1580109625" status: 202 len: 0 microversion: 2.1 time: 0.022496 Oct 17 04:37:15.030898 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 373/732] 10.222.0.40 () {58 vars in 1221 bytes} [Mon Oct 17 04:37:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1580109625 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:37:15.119168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6c39d056-864a-4515-b9ef-37991aceb8b2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:15.119902 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6c39d056-864a-4515-b9ef-37991aceb8b2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:15.129621 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c39d056-864a-4515-b9ef-37991aceb8b2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:15.130439 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c39d056-864a-4515-b9ef-37991aceb8b2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:15.131148 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c39d056-864a-4515-b9ef-37991aceb8b2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:15.131981 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c39d056-864a-4515-b9ef-37991aceb8b2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:15.132789 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c39d056-864a-4515-b9ef-37991aceb8b2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:15.133464 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6c39d056-864a-4515-b9ef-37991aceb8b2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:15.150385 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-6c39d056-864a-4515-b9ef-37991aceb8b2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] HTTP exception thrown: Instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 could not be found. Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6c39d056-864a-4515-b9ef-37991aceb8b2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Request method failure captured: Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 HTTP/1.1 Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNqRI5416bQSxgt6AXPotC0ZA8EQSE7l65zNcTm_mxUo9wFNmkuLDOKI-_C3Raae9FpamLQxUS44gziCftz35IAzDjSECza3w5spd_jxIdlfyyzXpOJTef9rLRzMW0mp2HVcK15b4ajr4hc5Lz_I9yQNIKfhl18_NwaTHORpu95fjDE Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:37:15.151971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:37:15.153403 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e022e6125e85417881ce226db7a5c764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e022e6125e85417881ce226db7a5c764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:15.153403 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:15.153403 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:37:15.153403 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:15.153403 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:37:15.153403 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:37:15.153403 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:37:15.153403 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: 59aa96241a8e4d9db6d255c38f618ca1 Oct 17 04:37:15.153403 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:37:15.153403 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:37:15.153403 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 could not be found. Oct 17 04:37:15.153403 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': '7cdbf4e7-ae88-4e26-a40b-cbd881612fe5'} Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 could not be found. Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:15.155402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 could not be found. Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 could not be found. Oct 17 04:37:15.156876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:15.158657 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6c39d056-864a-4515-b9ef-37991aceb8b2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Returning 404 to user: Instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:15.158657 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6c39d056-864a-4515-b9ef-37991aceb8b2 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 404 len: 111 microversion: 2.1 time: 0.038786 Oct 17 04:37:15.158657 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 360/733] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:37:15 2022] DELETE /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:37:15.162645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dddf561c-8c83-4048-b31b-cb4769c8394a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:15.163265 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-dddf561c-8c83-4048-b31b-cb4769c8394a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:15.169634 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dddf561c-8c83-4048-b31b-cb4769c8394a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:15.170374 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dddf561c-8c83-4048-b31b-cb4769c8394a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:15.171207 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dddf561c-8c83-4048-b31b-cb4769c8394a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:15.171788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dddf561c-8c83-4048-b31b-cb4769c8394a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:15.172277 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dddf561c-8c83-4048-b31b-cb4769c8394a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:15.172902 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-dddf561c-8c83-4048-b31b-cb4769c8394a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:15.187962 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-dddf561c-8c83-4048-b31b-cb4769c8394a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] HTTP exception thrown: Instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 could not be found. Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dddf561c-8c83-4048-b31b-cb4769c8394a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Request method failure captured: Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 HTTP/1.1 Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNqRI5416bQSxgt6AXPotC0ZA8EQSE7l65zNcTm_mxUo9wFNmkuLDOKI-_C3Raae9FpamLQxUS44gziCftz35IAzDjSECza3w5spd_jxIdlfyyzXpOJTef9rLRzMW0mp2HVcK15b4ajr4hc5Lz_I9yQNIKfhl18_NwaTHORpu95fjDE Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:37:15.190339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:37:15.191924 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e022e6125e85417881ce226db7a5c764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e022e6125e85417881ce226db7a5c764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:15.191924 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:15.191924 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:37:15.191924 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:15.191924 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:37:15.191924 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:37:15.191924 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:37:15.191924 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 59aa96241a8e4d9db6d255c38f618ca1 Oct 17 04:37:15.191924 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:37:15.191924 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:37:15.191924 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 could not be found. Oct 17 04:37:15.191924 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': '7cdbf4e7-ae88-4e26-a40b-cbd881612fe5'} Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 could not be found. Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:15.192883 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:15.194623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:15.194623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:37:15.194623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:37:15.194623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:37:15.194623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:37:15.194623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:37:15.194623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:37:15.194623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 could not be found. Oct 17 04:37:15.194623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:15.194623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:15.194623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:15.194623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:15.194623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:15.194623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:15.194623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:37:15.194623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:37:15.194623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 could not be found. Oct 17 04:37:15.194623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:15.197424 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-dddf561c-8c83-4048-b31b-cb4769c8394a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Returning 404 to user: Instance 7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:15.198643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-dddf561c-8c83-4048-b31b-cb4769c8394a tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5" status: 404 len: 111 microversion: 2.1 time: 0.039831 Oct 17 04:37:15.199691 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 374/734] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:15 2022] GET /compute/v2.1/servers/7cdbf4e7-ae88-4e26-a40b-cbd881612fe5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:37:15.364726 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-24d27f67-86f6-4cf2-aade-fac0835330ab tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:15.365932 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-24d27f67-86f6-4cf2-aade-fac0835330ab tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:15.375265 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24d27f67-86f6-4cf2-aade-fac0835330ab tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:15.376351 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24d27f67-86f6-4cf2-aade-fac0835330ab tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:15.377018 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24d27f67-86f6-4cf2-aade-fac0835330ab tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:15.379973 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24d27f67-86f6-4cf2-aade-fac0835330ab tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:15.381357 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24d27f67-86f6-4cf2-aade-fac0835330ab tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:15.382323 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-24d27f67-86f6-4cf2-aade-fac0835330ab tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:15.599491 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-24d27f67-86f6-4cf2-aade-fac0835330ab tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:15.614421 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-24d27f67-86f6-4cf2-aade-fac0835330ab tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:15.618140 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-24d27f67-86f6-4cf2-aade-fac0835330ab tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:15.622384 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-24d27f67-86f6-4cf2-aade-fac0835330ab tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1670 microversion: 2.20 time: 0.263532 Oct 17 04:37:15.623181 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 361/735] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:15 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1670 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:16.360670 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0db7bf7e-edfe-4959-a564-d2f7c17c59e9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:16.361352 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0db7bf7e-edfe-4959-a564-d2f7c17c59e9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:16.367710 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0db7bf7e-edfe-4959-a564-d2f7c17c59e9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:16.368198 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0db7bf7e-edfe-4959-a564-d2f7c17c59e9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:16.368637 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0db7bf7e-edfe-4959-a564-d2f7c17c59e9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:16.369439 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0db7bf7e-edfe-4959-a564-d2f7c17c59e9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:16.369895 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0db7bf7e-edfe-4959-a564-d2f7c17c59e9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:16.370320 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0db7bf7e-edfe-4959-a564-d2f7c17c59e9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:16.384416 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-0db7bf7e-edfe-4959-a564-d2f7c17c59e9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] HTTP exception thrown: Instance 00d500c7-5fa9-4811-8064-25f3c15d0928 could not be found. Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0db7bf7e-edfe-4959-a564-d2f7c17c59e9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Request method failure captured: Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 HTTP/1.1 Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNqRI5416bQSxgt6AXPotC0ZA8EQSE7l65zNcTm_mxUo9wFNmkuLDOKI-_C3Raae9FpamLQxUS44gziCftz35IAzDjSECza3w5spd_jxIdlfyyzXpOJTef9rLRzMW0mp2HVcK15b4ajr4hc5Lz_I9yQNIKfhl18_NwaTHORpu95fjDE Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:37:16.385930 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:37:16.387471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e022e6125e85417881ce226db7a5c764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e022e6125e85417881ce226db7a5c764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:16.387471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:16.387471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:37:16.387471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:16.387471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:37:16.387471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:37:16.387471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:37:16.387471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 59aa96241a8e4d9db6d255c38f618ca1 Oct 17 04:37:16.387471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:37:16.387471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:37:16.387471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance 00d500c7-5fa9-4811-8064-25f3c15d0928 could not be found. Oct 17 04:37:16.387471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': '00d500c7-5fa9-4811-8064-25f3c15d0928'} Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00d500c7-5fa9-4811-8064-25f3c15d0928 could not be found. Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:16.388376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00d500c7-5fa9-4811-8064-25f3c15d0928 could not be found. Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00d500c7-5fa9-4811-8064-25f3c15d0928 could not be found. Oct 17 04:37:16.390404 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.392969 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0db7bf7e-edfe-4959-a564-d2f7c17c59e9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Returning 404 to user: Instance 00d500c7-5fa9-4811-8064-25f3c15d0928 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:16.392969 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0db7bf7e-edfe-4959-a564-d2f7c17c59e9 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "DELETE /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928" status: 404 len: 111 microversion: 2.1 time: 0.031046 Oct 17 04:37:16.392969 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 375/736] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:37:16 2022] DELETE /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:37:16.395977 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-356dc884-b93d-427a-9948-d0eecf39d2f4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:16.396602 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-356dc884-b93d-427a-9948-d0eecf39d2f4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 00d500c7-5fa9-4811-8064-25f3c15d0928] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:16.403055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-356dc884-b93d-427a-9948-d0eecf39d2f4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:16.403535 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-356dc884-b93d-427a-9948-d0eecf39d2f4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:16.403973 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-356dc884-b93d-427a-9948-d0eecf39d2f4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:16.405177 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-356dc884-b93d-427a-9948-d0eecf39d2f4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:16.405962 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-356dc884-b93d-427a-9948-d0eecf39d2f4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:16.406402 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-356dc884-b93d-427a-9948-d0eecf39d2f4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:16.419735 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-356dc884-b93d-427a-9948-d0eecf39d2f4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] HTTP exception thrown: Instance 00d500c7-5fa9-4811-8064-25f3c15d0928 could not be found. Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-356dc884-b93d-427a-9948-d0eecf39d2f4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Request method failure captured: Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 HTTP/1.1 Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNqRI5416bQSxgt6AXPotC0ZA8EQSE7l65zNcTm_mxUo9wFNmkuLDOKI-_C3Raae9FpamLQxUS44gziCftz35IAzDjSECza3w5spd_jxIdlfyyzXpOJTef9rLRzMW0mp2HVcK15b4ajr4hc5Lz_I9yQNIKfhl18_NwaTHORpu95fjDE Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:37:16.422528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:37:16.424336 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e022e6125e85417881ce226db7a5c764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e022e6125e85417881ce226db7a5c764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:16.424336 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:16.424336 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:37:16.424336 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:16.424336 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:37:16.424336 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:37:16.424336 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:37:16.424336 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: 59aa96241a8e4d9db6d255c38f618ca1 Oct 17 04:37:16.424336 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:37:16.424336 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:37:16.424336 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance 00d500c7-5fa9-4811-8064-25f3c15d0928 could not be found. Oct 17 04:37:16.424336 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': '00d500c7-5fa9-4811-8064-25f3c15d0928'} Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00d500c7-5fa9-4811-8064-25f3c15d0928 could not be found. Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:16.425187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:16.426371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:16.426371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:37:16.426371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:37:16.426371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:37:16.426371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:37:16.426371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:37:16.426371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:37:16.426371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00d500c7-5fa9-4811-8064-25f3c15d0928 could not be found. Oct 17 04:37:16.426371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.426371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:16.426371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.426371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:16.426371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:16.426371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:16.426371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:37:16.426371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:37:16.426371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00d500c7-5fa9-4811-8064-25f3c15d0928 could not be found. Oct 17 04:37:16.426371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.427862 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-356dc884-b93d-427a-9948-d0eecf39d2f4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Returning 404 to user: Instance 00d500c7-5fa9-4811-8064-25f3c15d0928 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:16.427862 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-356dc884-b93d-427a-9948-d0eecf39d2f4 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928" status: 404 len: 111 microversion: 2.1 time: 0.031765 Oct 17 04:37:16.427862 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 362/737] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:16 2022] GET /compute/v2.1/servers/00d500c7-5fa9-4811-8064-25f3c15d0928 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 04:37:16.432348 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d7c9ba42-3d99-427b-b666-3753fe1636b1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:16.432852 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d7c9ba42-3d99-427b-b666-3753fe1636b1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:16.438979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7c9ba42-3d99-427b-b666-3753fe1636b1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:16.439462 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7c9ba42-3d99-427b-b666-3753fe1636b1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:16.439945 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7c9ba42-3d99-427b-b666-3753fe1636b1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:16.440596 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7c9ba42-3d99-427b-b666-3753fe1636b1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:16.441048 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7c9ba42-3d99-427b-b666-3753fe1636b1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:16.441498 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7c9ba42-3d99-427b-b666-3753fe1636b1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:16.455070 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-d7c9ba42-3d99-427b-b666-3753fe1636b1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] HTTP exception thrown: Instance 77752d3b-6577-45d9-b7f4-1bca4ee444be could not be found. Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d7c9ba42-3d99-427b-b666-3753fe1636b1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Request method failure captured: Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be HTTP/1.1 Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNqRI5416bQSxgt6AXPotC0ZA8EQSE7l65zNcTm_mxUo9wFNmkuLDOKI-_C3Raae9FpamLQxUS44gziCftz35IAzDjSECza3w5spd_jxIdlfyyzXpOJTef9rLRzMW0mp2HVcK15b4ajr4hc5Lz_I9yQNIKfhl18_NwaTHORpu95fjDE Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:37:16.456645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:37:16.458333 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e022e6125e85417881ce226db7a5c764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e022e6125e85417881ce226db7a5c764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:16.458333 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:16.458333 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:37:16.458333 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:16.458333 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:37:16.458333 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:37:16.458333 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:37:16.458333 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 59aa96241a8e4d9db6d255c38f618ca1 Oct 17 04:37:16.458333 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:37:16.458333 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:37:16.458333 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance 77752d3b-6577-45d9-b7f4-1bca4ee444be could not be found. Oct 17 04:37:16.458333 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': '77752d3b-6577-45d9-b7f4-1bca4ee444be'} Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77752d3b-6577-45d9-b7f4-1bca4ee444be could not be found. Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:16.459546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77752d3b-6577-45d9-b7f4-1bca4ee444be could not be found. Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77752d3b-6577-45d9-b7f4-1bca4ee444be could not be found. Oct 17 04:37:16.461066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.462565 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d7c9ba42-3d99-427b-b666-3753fe1636b1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Returning 404 to user: Instance 77752d3b-6577-45d9-b7f4-1bca4ee444be could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:16.462565 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d7c9ba42-3d99-427b-b666-3753fe1636b1 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "DELETE /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 404 len: 111 microversion: 2.1 time: 0.029577 Oct 17 04:37:16.462565 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 376/738] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:37:16 2022] DELETE /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:37:16.467125 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7ad7d30a-0d0a-4288-8851-2e55cdccd075 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:16.468602 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7ad7d30a-0d0a-4288-8851-2e55cdccd075 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: 77752d3b-6577-45d9-b7f4-1bca4ee444be] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:16.474689 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ad7d30a-0d0a-4288-8851-2e55cdccd075 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:16.475247 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ad7d30a-0d0a-4288-8851-2e55cdccd075 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:16.475756 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ad7d30a-0d0a-4288-8851-2e55cdccd075 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:16.476519 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ad7d30a-0d0a-4288-8851-2e55cdccd075 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:16.477040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ad7d30a-0d0a-4288-8851-2e55cdccd075 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:16.477579 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ad7d30a-0d0a-4288-8851-2e55cdccd075 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:16.491591 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-7ad7d30a-0d0a-4288-8851-2e55cdccd075 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] HTTP exception thrown: Instance 77752d3b-6577-45d9-b7f4-1bca4ee444be could not be found. Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7ad7d30a-0d0a-4288-8851-2e55cdccd075 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Request method failure captured: Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be HTTP/1.1 Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNqRI5416bQSxgt6AXPotC0ZA8EQSE7l65zNcTm_mxUo9wFNmkuLDOKI-_C3Raae9FpamLQxUS44gziCftz35IAzDjSECza3w5spd_jxIdlfyyzXpOJTef9rLRzMW0mp2HVcK15b4ajr4hc5Lz_I9yQNIKfhl18_NwaTHORpu95fjDE Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:37:16.493233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:37:16.494632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e022e6125e85417881ce226db7a5c764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e022e6125e85417881ce226db7a5c764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:16.494632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:16.494632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:37:16.494632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:16.494632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:37:16.494632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:37:16.494632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:37:16.494632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: 59aa96241a8e4d9db6d255c38f618ca1 Oct 17 04:37:16.494632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:37:16.494632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:37:16.494632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance 77752d3b-6577-45d9-b7f4-1bca4ee444be could not be found. Oct 17 04:37:16.494632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': '77752d3b-6577-45d9-b7f4-1bca4ee444be'} Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77752d3b-6577-45d9-b7f4-1bca4ee444be could not be found. Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:16.495382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:16.496593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:16.496593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:37:16.496593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:37:16.496593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:37:16.496593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:37:16.496593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:37:16.496593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:37:16.496593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77752d3b-6577-45d9-b7f4-1bca4ee444be could not be found. Oct 17 04:37:16.496593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.496593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:16.496593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.496593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:16.496593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:16.496593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:16.496593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:37:16.496593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:37:16.496593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77752d3b-6577-45d9-b7f4-1bca4ee444be could not be found. Oct 17 04:37:16.496593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:16.497696 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7ad7d30a-0d0a-4288-8851-2e55cdccd075 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Returning 404 to user: Instance 77752d3b-6577-45d9-b7f4-1bca4ee444be could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:16.497696 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7ad7d30a-0d0a-4288-8851-2e55cdccd075 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be" status: 404 len: 111 microversion: 2.1 time: 0.032068 Oct 17 04:37:16.497696 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 363/739] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:16 2022] GET /compute/v2.1/servers/77752d3b-6577-45d9-b7f4-1bca4ee444be => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 04:37:16.650458 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a9633281-bab7-4162-870f-e430a05ee516 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:16.651068 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a9633281-bab7-4162-870f-e430a05ee516 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:16.657610 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a9633281-bab7-4162-870f-e430a05ee516 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:16.658088 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a9633281-bab7-4162-870f-e430a05ee516 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:16.658522 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a9633281-bab7-4162-870f-e430a05ee516 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:16.659202 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a9633281-bab7-4162-870f-e430a05ee516 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:16.659651 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a9633281-bab7-4162-870f-e430a05ee516 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:16.660073 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a9633281-bab7-4162-870f-e430a05ee516 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:16.807758 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a9633281-bab7-4162-870f-e430a05ee516 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:16.817050 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a9633281-bab7-4162-870f-e430a05ee516 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:16.818630 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a9633281-bab7-4162-870f-e430a05ee516 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:16.820212 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a9633281-bab7-4162-870f-e430a05ee516 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1728 microversion: 2.20 time: 0.173377 Oct 17 04:37:16.820580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 377/740] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:16 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:37:17.636859 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b9cefcba-47aa-4263-b450-8aad127b36bb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:17.637393 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b9cefcba-47aa-4263-b450-8aad127b36bb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:17.644317 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9cefcba-47aa-4263-b450-8aad127b36bb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:17.644796 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9cefcba-47aa-4263-b450-8aad127b36bb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:17.645272 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9cefcba-47aa-4263-b450-8aad127b36bb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:17.645963 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9cefcba-47aa-4263-b450-8aad127b36bb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:17.646418 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9cefcba-47aa-4263-b450-8aad127b36bb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:17.646838 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b9cefcba-47aa-4263-b450-8aad127b36bb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:17.660527 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-b9cefcba-47aa-4263-b450-8aad127b36bb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] HTTP exception thrown: Instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 could not be found. Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b9cefcba-47aa-4263-b450-8aad127b36bb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Request method failure captured: Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 HTTP/1.1 Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNqRI5416bQSxgt6AXPotC0ZA8EQSE7l65zNcTm_mxUo9wFNmkuLDOKI-_C3Raae9FpamLQxUS44gziCftz35IAzDjSECza3w5spd_jxIdlfyyzXpOJTef9rLRzMW0mp2HVcK15b4ajr4hc5Lz_I9yQNIKfhl18_NwaTHORpu95fjDE Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:37:17.662142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:37:17.663913 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e022e6125e85417881ce226db7a5c764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e022e6125e85417881ce226db7a5c764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:17.663913 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:17.663913 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:37:17.663913 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:17.663913 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:37:17.663913 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:37:17.663913 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:37:17.663913 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: 59aa96241a8e4d9db6d255c38f618ca1 Oct 17 04:37:17.663913 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:37:17.663913 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:37:17.663913 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 could not be found. Oct 17 04:37:17.663913 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': 'ffc759c8-a208-4df1-bf3e-dd2b89bff369'} Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 could not be found. Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:17.664674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 could not be found. Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 could not be found. Oct 17 04:37:17.666729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:17.668100 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b9cefcba-47aa-4263-b450-8aad127b36bb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Returning 404 to user: Instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:17.668100 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b9cefcba-47aa-4263-b450-8aad127b36bb tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 404 len: 111 microversion: 2.1 time: 0.030448 Oct 17 04:37:17.668100 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 364/741] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:37:17 2022] DELETE /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:37:17.672329 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f824cffe-6c26-4b1a-b0e2-acdb9161d769 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:17.672959 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f824cffe-6c26-4b1a-b0e2-acdb9161d769 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] [instance: ffc759c8-a208-4df1-bf3e-dd2b89bff369] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:17.679440 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f824cffe-6c26-4b1a-b0e2-acdb9161d769 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:17.679929 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f824cffe-6c26-4b1a-b0e2-acdb9161d769 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:17.680371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f824cffe-6c26-4b1a-b0e2-acdb9161d769 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:17.681089 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f824cffe-6c26-4b1a-b0e2-acdb9161d769 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:17.681550 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f824cffe-6c26-4b1a-b0e2-acdb9161d769 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:17.681982 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f824cffe-6c26-4b1a-b0e2-acdb9161d769 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:17.697929 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-f824cffe-6c26-4b1a-b0e2-acdb9161d769 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] HTTP exception thrown: Instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 could not be found. Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f824cffe-6c26-4b1a-b0e2-acdb9161d769 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Request method failure captured: Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 HTTP/1.1 Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNqRI5416bQSxgt6AXPotC0ZA8EQSE7l65zNcTm_mxUo9wFNmkuLDOKI-_C3Raae9FpamLQxUS44gziCftz35IAzDjSECza3w5spd_jxIdlfyyzXpOJTef9rLRzMW0mp2HVcK15b4ajr4hc5Lz_I9yQNIKfhl18_NwaTHORpu95fjDE Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:37:17.699419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:37:17.702042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e022e6125e85417881ce226db7a5c764"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e022e6125e85417881ce226db7a5c764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e022e6125e85417881ce226db7a5c764"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:17.702042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:17.702042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: e022e6125e85417881ce226db7a5c764 Oct 17 04:37:17.702042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1381569619 Oct 17 04:37:17.702042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:37:17.702042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:37:17.702042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:37:17.702042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 59aa96241a8e4d9db6d255c38f618ca1 Oct 17 04:37:17.702042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeNegativeTest-1381569619-project Oct 17 04:37:17.702042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:37:17.702042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 could not be found. Oct 17 04:37:17.702042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': 'ffc759c8-a208-4df1-bf3e-dd2b89bff369'} Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 could not be found. Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:17.703140 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:17.704580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:17.704580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:37:17.704580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:37:17.704580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:37:17.704580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:37:17.704580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:37:17.704580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:37:17.704580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 could not be found. Oct 17 04:37:17.704580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:17.704580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:17.704580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:17.704580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:17.704580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:17.704580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:17.704580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:37:17.704580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:37:17.704580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 could not be found. Oct 17 04:37:17.704580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:17.706009 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f824cffe-6c26-4b1a-b0e2-acdb9161d769 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] Returning 404 to user: Instance ffc759c8-a208-4df1-bf3e-dd2b89bff369 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:17.706009 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f824cffe-6c26-4b1a-b0e2-acdb9161d769 tempest-AttachVolumeNegativeTest-1381569619 tempest-AttachVolumeNegativeTest-1381569619-project] 10.222.0.40 "GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369" status: 404 len: 111 microversion: 2.1 time: 0.032430 Oct 17 04:37:17.706009 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 378/742] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:17 2022] GET /compute/v2.1/servers/ffc759c8-a208-4df1-bf3e-dd2b89bff369 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:37:17.847122 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d9459e52-a3b1-4e4b-8de3-4cc7549cc1f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:17.847885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d9459e52-a3b1-4e4b-8de3-4cc7549cc1f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:17.853954 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d9459e52-a3b1-4e4b-8de3-4cc7549cc1f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:17.854681 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d9459e52-a3b1-4e4b-8de3-4cc7549cc1f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:17.855350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d9459e52-a3b1-4e4b-8de3-4cc7549cc1f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:17.856312 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d9459e52-a3b1-4e4b-8de3-4cc7549cc1f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:17.856770 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d9459e52-a3b1-4e4b-8de3-4cc7549cc1f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:17.857451 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d9459e52-a3b1-4e4b-8de3-4cc7549cc1f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:18.007066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d9459e52-a3b1-4e4b-8de3-4cc7549cc1f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:18.024136 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d9459e52-a3b1-4e4b-8de3-4cc7549cc1f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:18.026392 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d9459e52-a3b1-4e4b-8de3-4cc7549cc1f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:18.027818 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d9459e52-a3b1-4e4b-8de3-4cc7549cc1f8 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1728 microversion: 2.20 time: 0.185461 Oct 17 04:37:18.029141 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 365/743] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:17 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:18.106016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-757e2173-0ab9-46f1-a09b-d4a6769141d1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:18.106702 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-757e2173-0ab9-46f1-a09b-d4a6769141d1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:18.121330 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-757e2173-0ab9-46f1-a09b-d4a6769141d1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:18.127393 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-757e2173-0ab9-46f1-a09b-d4a6769141d1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:18.128071 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-757e2173-0ab9-46f1-a09b-d4a6769141d1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:18.129012 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-757e2173-0ab9-46f1-a09b-d4a6769141d1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:18.130270 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-757e2173-0ab9-46f1-a09b-d4a6769141d1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:18.130876 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-757e2173-0ab9-46f1-a09b-d4a6769141d1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:18.153394 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-757e2173-0ab9-46f1-a09b-d4a6769141d1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] HTTP exception thrown: Instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c could not be found. Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-757e2173-0ab9-46f1-a09b-d4a6769141d1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Request method failure captured: Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c HTTP/1.1 Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNqRUiXt4PHEZM45Sl2dRGKw92wrAMscBJB9ZAwCEDIPH2HxVsoMIKkUKFHPlERhunaUHlnBmKrDLC-749DjsE3-Tz_Ttygz1dTltMlQqDMBzpc2WOagOL29Oy1j5ERZPVQ95iO44jL5tdGPvvwoVWPS8zmeonSpbFiTmRzLyai1Uck Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: 9de6141e0c3a41bcb84ac635b48a51df Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeTestJSON-1936456196 Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:37:18.155310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:37:18.156864 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:18.156864 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeTestJSON-1936456196 Oct 17 04:37:18.156864 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: 9de6141e0c3a41bcb84ac635b48a51df Oct 17 04:37:18.156864 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1936456196 Oct 17 04:37:18.156864 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-AttachVolumeTestJSON-1936456196-project Oct 17 04:37:18.156864 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:37:18.156864 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:37:18.156864 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 78eac67939a44d0fa99cb748b56f7b70 Oct 17 04:37:18.156864 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeTestJSON-1936456196-project Oct 17 04:37:18.156864 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:37:18.156864 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c could not be found. Oct 17 04:37:18.156864 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': '8fb709e6-ba7f-4703-8f7f-365c33a1c79c'} Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c could not be found. Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:18.157788 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c could not be found. Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c could not be found. Oct 17 04:37:18.161306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:18.162952 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-757e2173-0ab9-46f1-a09b-d4a6769141d1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Returning 404 to user: Instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:18.162952 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-757e2173-0ab9-46f1-a09b-d4a6769141d1 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 404 len: 111 microversion: 2.1 time: 0.058996 Oct 17 04:37:18.162952 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 379/744] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:37:18 2022] DELETE /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:37:18.167948 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d0da6781-07a5-4d7a-9edb-159a9a06b507 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:18.168679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d0da6781-07a5-4d7a-9edb-159a9a06b507 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: 8fb709e6-ba7f-4703-8f7f-365c33a1c79c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:18.174938 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0da6781-07a5-4d7a-9edb-159a9a06b507 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:18.175581 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0da6781-07a5-4d7a-9edb-159a9a06b507 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:18.176117 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0da6781-07a5-4d7a-9edb-159a9a06b507 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:18.176941 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0da6781-07a5-4d7a-9edb-159a9a06b507 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:18.177528 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0da6781-07a5-4d7a-9edb-159a9a06b507 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:18.178055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d0da6781-07a5-4d7a-9edb-159a9a06b507 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:18.194795 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-d0da6781-07a5-4d7a-9edb-159a9a06b507 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] HTTP exception thrown: Instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c could not be found. Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d0da6781-07a5-4d7a-9edb-159a9a06b507 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Request method failure captured: Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c HTTP/1.1 Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNqRUiXt4PHEZM45Sl2dRGKw92wrAMscBJB9ZAwCEDIPH2HxVsoMIKkUKFHPlERhunaUHlnBmKrDLC-749DjsE3-Tz_Ttygz1dTltMlQqDMBzpc2WOagOL29Oy1j5ERZPVQ95iO44jL5tdGPvvwoVWPS8zmeonSpbFiTmRzLyai1Uck Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: 9de6141e0c3a41bcb84ac635b48a51df Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeTestJSON-1936456196 Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:37:18.196485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:37:18.198098 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:18.198098 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeTestJSON-1936456196 Oct 17 04:37:18.198098 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: 9de6141e0c3a41bcb84ac635b48a51df Oct 17 04:37:18.198098 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1936456196 Oct 17 04:37:18.198098 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-AttachVolumeTestJSON-1936456196-project Oct 17 04:37:18.198098 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:37:18.198098 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:37:18.198098 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: 78eac67939a44d0fa99cb748b56f7b70 Oct 17 04:37:18.198098 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeTestJSON-1936456196-project Oct 17 04:37:18.198098 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:37:18.198098 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c could not be found. Oct 17 04:37:18.198098 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': '8fb709e6-ba7f-4703-8f7f-365c33a1c79c'} Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c could not be found. Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:18.199055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:18.200533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:18.200533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:37:18.200533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:37:18.200533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:37:18.200533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:37:18.200533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:37:18.200533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:37:18.200533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c could not be found. Oct 17 04:37:18.200533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:18.200533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:18.200533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:18.200533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:18.200533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:18.200533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:18.200533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:37:18.200533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:37:18.200533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c could not be found. Oct 17 04:37:18.200533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:18.203263 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d0da6781-07a5-4d7a-9edb-159a9a06b507 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Returning 404 to user: Instance 8fb709e6-ba7f-4703-8f7f-365c33a1c79c could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:18.203263 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d0da6781-07a5-4d7a-9edb-159a9a06b507 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c" status: 404 len: 111 microversion: 2.1 time: 0.036237 Oct 17 04:37:18.203263 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 366/745] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:18 2022] GET /compute/v2.1/servers/8fb709e6-ba7f-4703-8f7f-365c33a1c79c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:37:19.053577 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-35089243-2439-4076-9a1a-ff95f77e5821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:19.054194 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-35089243-2439-4076-9a1a-ff95f77e5821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:19.061717 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35089243-2439-4076-9a1a-ff95f77e5821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:19.062634 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35089243-2439-4076-9a1a-ff95f77e5821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:19.063241 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35089243-2439-4076-9a1a-ff95f77e5821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:19.064126 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35089243-2439-4076-9a1a-ff95f77e5821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:19.064739 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35089243-2439-4076-9a1a-ff95f77e5821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:19.065445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-35089243-2439-4076-9a1a-ff95f77e5821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:19.307651 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-35089243-2439-4076-9a1a-ff95f77e5821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:19.331348 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-35089243-2439-4076-9a1a-ff95f77e5821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:19.336256 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-35089243-2439-4076-9a1a-ff95f77e5821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:19.346678 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-35089243-2439-4076-9a1a-ff95f77e5821 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1728 microversion: 2.20 time: 0.296816 Oct 17 04:37:19.360973 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 380/746] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:19 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1728 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:19.422259 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e73e33b0-33ea-4984-9c84-0fbe552d1e44 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:19.422891 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e73e33b0-33ea-4984-9c84-0fbe552d1e44 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:19.435352 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e73e33b0-33ea-4984-9c84-0fbe552d1e44 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:19.436511 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e73e33b0-33ea-4984-9c84-0fbe552d1e44 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:19.437032 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e73e33b0-33ea-4984-9c84-0fbe552d1e44 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:19.438088 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e73e33b0-33ea-4984-9c84-0fbe552d1e44 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:19.440959 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e73e33b0-33ea-4984-9c84-0fbe552d1e44 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:19.441504 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e73e33b0-33ea-4984-9c84-0fbe552d1e44 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:19.467814 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-e73e33b0-33ea-4984-9c84-0fbe552d1e44 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] HTTP exception thrown: Instance bf59bfb1-79b1-4ebe-9635-380231dec617 could not be found. Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e73e33b0-33ea-4984-9c84-0fbe552d1e44 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Request method failure captured: Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 HTTP/1.1 Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNqRUiXt4PHEZM45Sl2dRGKw92wrAMscBJB9ZAwCEDIPH2HxVsoMIKkUKFHPlERhunaUHlnBmKrDLC-749DjsE3-Tz_Ttygz1dTltMlQqDMBzpc2WOagOL29Oy1j5ERZPVQ95iO44jL5tdGPvvwoVWPS8zmeonSpbFiTmRzLyai1Uck Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: 9de6141e0c3a41bcb84ac635b48a51df Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeTestJSON-1936456196 Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:37:19.472994 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:37:19.474560 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:19.474560 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeTestJSON-1936456196 Oct 17 04:37:19.474560 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: 9de6141e0c3a41bcb84ac635b48a51df Oct 17 04:37:19.474560 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1936456196 Oct 17 04:37:19.474560 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-AttachVolumeTestJSON-1936456196-project Oct 17 04:37:19.474560 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:37:19.474560 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:37:19.474560 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: 78eac67939a44d0fa99cb748b56f7b70 Oct 17 04:37:19.474560 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeTestJSON-1936456196-project Oct 17 04:37:19.474560 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:37:19.474560 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance bf59bfb1-79b1-4ebe-9635-380231dec617 could not be found. Oct 17 04:37:19.474560 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': 'bf59bfb1-79b1-4ebe-9635-380231dec617'} Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf59bfb1-79b1-4ebe-9635-380231dec617 could not be found. Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:19.475473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf59bfb1-79b1-4ebe-9635-380231dec617 could not be found. Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf59bfb1-79b1-4ebe-9635-380231dec617 could not be found. Oct 17 04:37:19.476788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:19.485720 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e73e33b0-33ea-4984-9c84-0fbe552d1e44 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Returning 404 to user: Instance bf59bfb1-79b1-4ebe-9635-380231dec617 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:19.486989 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e73e33b0-33ea-4984-9c84-0fbe552d1e44 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 404 len: 111 microversion: 2.1 time: 0.069454 Oct 17 04:37:19.487728 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 367/747] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:37:19 2022] DELETE /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:37:19.495757 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eca2c8ed-61cc-4459-aa60-a93adc08a570 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:19.496375 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-eca2c8ed-61cc-4459-aa60-a93adc08a570 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] [instance: bf59bfb1-79b1-4ebe-9635-380231dec617] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:19.503541 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eca2c8ed-61cc-4459-aa60-a93adc08a570 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:19.504042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eca2c8ed-61cc-4459-aa60-a93adc08a570 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:19.504482 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eca2c8ed-61cc-4459-aa60-a93adc08a570 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:19.505310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eca2c8ed-61cc-4459-aa60-a93adc08a570 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:19.505753 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eca2c8ed-61cc-4459-aa60-a93adc08a570 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:19.506180 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-eca2c8ed-61cc-4459-aa60-a93adc08a570 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:19.525597 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-eca2c8ed-61cc-4459-aa60-a93adc08a570 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] HTTP exception thrown: Instance bf59bfb1-79b1-4ebe-9635-380231dec617 could not be found. Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eca2c8ed-61cc-4459-aa60-a93adc08a570 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Request method failure captured: Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 HTTP/1.1 Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNqRUiXt4PHEZM45Sl2dRGKw92wrAMscBJB9ZAwCEDIPH2HxVsoMIKkUKFHPlERhunaUHlnBmKrDLC-749DjsE3-Tz_Ttygz1dTltMlQqDMBzpc2WOagOL29Oy1j5ERZPVQ95iO44jL5tdGPvvwoVWPS8zmeonSpbFiTmRzLyai1Uck Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: 9de6141e0c3a41bcb84ac635b48a51df Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeTestJSON-1936456196 Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:37:19.527077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:37:19.528723 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9de6141e0c3a41bcb84ac635b48a51df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:19.528723 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeTestJSON-1936456196 Oct 17 04:37:19.528723 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: 9de6141e0c3a41bcb84ac635b48a51df Oct 17 04:37:19.528723 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1936456196 Oct 17 04:37:19.528723 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-AttachVolumeTestJSON-1936456196-project Oct 17 04:37:19.528723 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:37:19.528723 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:37:19.528723 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 78eac67939a44d0fa99cb748b56f7b70 Oct 17 04:37:19.528723 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeTestJSON-1936456196-project Oct 17 04:37:19.528723 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:37:19.528723 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance bf59bfb1-79b1-4ebe-9635-380231dec617 could not be found. Oct 17 04:37:19.528723 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': 'bf59bfb1-79b1-4ebe-9635-380231dec617'} Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf59bfb1-79b1-4ebe-9635-380231dec617 could not be found. Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:19.529865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:19.531361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:19.531361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:37:19.531361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:37:19.531361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:37:19.531361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:37:19.531361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:37:19.531361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:37:19.531361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf59bfb1-79b1-4ebe-9635-380231dec617 could not be found. Oct 17 04:37:19.531361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:19.531361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:19.531361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:19.531361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:19.531361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:19.531361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:19.531361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:37:19.531361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:37:19.531361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf59bfb1-79b1-4ebe-9635-380231dec617 could not be found. Oct 17 04:37:19.531361 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:19.532798 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-eca2c8ed-61cc-4459-aa60-a93adc08a570 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] Returning 404 to user: Instance bf59bfb1-79b1-4ebe-9635-380231dec617 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:19.532798 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-eca2c8ed-61cc-4459-aa60-a93adc08a570 tempest-AttachVolumeTestJSON-1936456196 tempest-AttachVolumeTestJSON-1936456196-project] 10.222.0.40 "GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617" status: 404 len: 111 microversion: 2.1 time: 0.036864 Oct 17 04:37:19.532798 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 381/748] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:19 2022] GET /compute/v2.1/servers/bf59bfb1-79b1-4ebe-9635-380231dec617 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:37:20.375298 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-90eb4df4-674d-43ef-9106-ac3039be5835 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:20.379352 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-90eb4df4-674d-43ef-9106-ac3039be5835 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:20.394632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90eb4df4-674d-43ef-9106-ac3039be5835 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:20.395410 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90eb4df4-674d-43ef-9106-ac3039be5835 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:20.396003 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90eb4df4-674d-43ef-9106-ac3039be5835 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:20.398527 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90eb4df4-674d-43ef-9106-ac3039be5835 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:20.406978 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90eb4df4-674d-43ef-9106-ac3039be5835 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:20.408315 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-90eb4df4-674d-43ef-9106-ac3039be5835 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:20.872607 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-90eb4df4-674d-43ef-9106-ac3039be5835 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:20.893964 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-90eb4df4-674d-43ef-9106-ac3039be5835 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:20.896816 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-90eb4df4-674d-43ef-9106-ac3039be5835 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:20.902571 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-90eb4df4-674d-43ef-9106-ac3039be5835 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1728 microversion: 2.20 time: 0.532316 Oct 17 04:37:20.903304 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 368/749] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:20 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1728 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:21.941647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4a046b47-4581-42ae-95fe-1889bdf00fd7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:21.942506 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4a046b47-4581-42ae-95fe-1889bdf00fd7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:21.976810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a046b47-4581-42ae-95fe-1889bdf00fd7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:21.979691 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a046b47-4581-42ae-95fe-1889bdf00fd7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:21.980396 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a046b47-4581-42ae-95fe-1889bdf00fd7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:21.996849 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a046b47-4581-42ae-95fe-1889bdf00fd7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:22.001808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a046b47-4581-42ae-95fe-1889bdf00fd7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:22.003377 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4a046b47-4581-42ae-95fe-1889bdf00fd7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:22.048270 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:37:22.413131 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-4a046b47-4581-42ae-95fe-1889bdf00fd7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:22.425583 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-4a046b47-4581-42ae-95fe-1889bdf00fd7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:22.429625 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-4a046b47-4581-42ae-95fe-1889bdf00fd7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:22.435544 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4a046b47-4581-42ae-95fe-1889bdf00fd7 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1728 microversion: 2.20 time: 0.501703 Oct 17 04:37:22.438268 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 382/750] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:21 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1728 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:23.468864 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c4ccc98f-e099-41d4-9f07-c05107398cfb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:23.469696 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c4ccc98f-e099-41d4-9f07-c05107398cfb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:23.479099 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4ccc98f-e099-41d4-9f07-c05107398cfb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:23.482100 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4ccc98f-e099-41d4-9f07-c05107398cfb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:23.484464 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4ccc98f-e099-41d4-9f07-c05107398cfb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:23.485307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4ccc98f-e099-41d4-9f07-c05107398cfb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:23.485838 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4ccc98f-e099-41d4-9f07-c05107398cfb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:23.486506 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c4ccc98f-e099-41d4-9f07-c05107398cfb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:23.800150 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-c4ccc98f-e099-41d4-9f07-c05107398cfb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:23.823920 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-c4ccc98f-e099-41d4-9f07-c05107398cfb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:23.826050 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-c4ccc98f-e099-41d4-9f07-c05107398cfb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:23.827410 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c4ccc98f-e099-41d4-9f07-c05107398cfb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1728 microversion: 2.20 time: 0.362468 Oct 17 04:37:23.829289 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 369/751] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:23 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1728 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:24.855392 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2e64a6bf-cd61-465f-9d5e-bbf03a677bed tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:24.856065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2e64a6bf-cd61-465f-9d5e-bbf03a677bed tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:24.873283 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e64a6bf-cd61-465f-9d5e-bbf03a677bed tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:24.873786 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e64a6bf-cd61-465f-9d5e-bbf03a677bed tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:24.874425 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e64a6bf-cd61-465f-9d5e-bbf03a677bed tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:24.875144 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e64a6bf-cd61-465f-9d5e-bbf03a677bed tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:24.875596 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e64a6bf-cd61-465f-9d5e-bbf03a677bed tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:24.876020 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2e64a6bf-cd61-465f-9d5e-bbf03a677bed tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:25.559472 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-2e64a6bf-cd61-465f-9d5e-bbf03a677bed tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:25.568544 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-2e64a6bf-cd61-465f-9d5e-bbf03a677bed tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:25.570028 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-2e64a6bf-cd61-465f-9d5e-bbf03a677bed tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:25.571200 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2e64a6bf-cd61-465f-9d5e-bbf03a677bed tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1728 microversion: 2.20 time: 0.719894 Oct 17 04:37:25.590088 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 383/752] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:24 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1728 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:26.596026 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-081bdf76-6662-48ef-a7dd-7da66db10cd4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:26.596659 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-081bdf76-6662-48ef-a7dd-7da66db10cd4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:26.602976 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-081bdf76-6662-48ef-a7dd-7da66db10cd4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:26.603450 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-081bdf76-6662-48ef-a7dd-7da66db10cd4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:26.603918 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-081bdf76-6662-48ef-a7dd-7da66db10cd4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:26.604607 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-081bdf76-6662-48ef-a7dd-7da66db10cd4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:26.605056 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-081bdf76-6662-48ef-a7dd-7da66db10cd4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:26.605498 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-081bdf76-6662-48ef-a7dd-7da66db10cd4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:26.737005 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-081bdf76-6662-48ef-a7dd-7da66db10cd4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:26.745947 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-081bdf76-6662-48ef-a7dd-7da66db10cd4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:26.747380 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-081bdf76-6662-48ef-a7dd-7da66db10cd4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:26.748580 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-081bdf76-6662-48ef-a7dd-7da66db10cd4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1728 microversion: 2.20 time: 0.156684 Oct 17 04:37:26.749149 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 370/753] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:26 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:26.794469 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-40a4d083-8ae1-477a-bcf8-11a721eb2ba0 tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] Action: 'create', calling method: .version_select at 0x7fc630cbb5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1866157381", "metadata": {"Type": "work"}}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-40a4d083-8ae1-477a-bcf8-11a721eb2ba0 tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] Request method failure captured: Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 122 Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNwGLhbdWLX9f2VtQu0j9FvCOW83b3AjR_lVvjq28ohOYbb6NgWzIKjAaZh0-KrKNMJYy-Isb-VoeuqN2ry5xeKxSTwdOTIq_rvAP6V4xiLLm6KI-pauA0HJUYg8e-4B_gWamKsHHrpA0OI0KnaNn1bbp1L8XieKdHkmA9-frrFVcqI Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: e511252cd28247069d96b2378a31f23c Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-VolumesNegativeTest-1905947698 Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:37:26.820808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:37:26.822493 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e511252cd28247069d96b2378a31f23c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e511252cd28247069d96b2378a31f23c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e511252cd28247069d96b2378a31f23c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e511252cd28247069d96b2378a31f23c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:26.822493 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-VolumesNegativeTest-1905947698 Oct 17 04:37:26.822493 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: e511252cd28247069d96b2378a31f23c Oct 17 04:37:26.822493 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-VolumesNegativeTest-1905947698 Oct 17 04:37:26.822493 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-VolumesNegativeTest-1905947698-project Oct 17 04:37:26.822493 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:37:26.822493 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:37:26.822493 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: b2fa47a03e3d4735bb497535160c6ffc Oct 17 04:37:26.822493 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-VolumesNegativeTest-1905947698-project Oct 17 04:37:26.822493 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Oct 17 04:37:26.822493 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1866157381", "metadata": {"Type": "work"}}} Oct 17 04:37:26.822493 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: Oct 17 04:37:26.822493 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1866157381', 'metadata': {'Type': 'work'}}}} Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi '#$%' Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:26.823592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:26.825310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 04:37:26.825310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 04:37:26.825310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:26.825310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:26.825310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 04:37:26.825310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 04:37:26.825310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 04:37:26.825310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 04:37:26.825310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 04:37:26.825310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 04:37:26.825310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 04:37:26.825310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.825310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:26.825310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.825310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:26.825310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:26.825310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:26.825310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 04:37:26.825310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 04:37:26.827193 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 04:37:26.827193 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.827193 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-40a4d083-8ae1-477a-bcf8-11a721eb2ba0 tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:26.827193 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-40a4d083-8ae1-477a-bcf8-11a721eb2ba0 tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.143467 Oct 17 04:37:26.827193 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 384/754] 10.222.0.40 () {60 vars in 1156 bytes} [Mon Oct 17 04:37:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 04:37:26.833397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fbe430c1-2293-4673-ae2a-54b989f87f8e tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] Action: 'create', calling method: .version_select at 0x7fc630f214c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-53399567", "metadata": {"Type": "work"}}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fbe430c1-2293-4673-ae2a-54b989f87f8e tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] Request method failure captured: Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 118 Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNwGLhbdWLX9f2VtQu0j9FvCOW83b3AjR_lVvjq28ohOYbb6NgWzIKjAaZh0-KrKNMJYy-Isb-VoeuqN2ry5xeKxSTwdOTIq_rvAP6V4xiLLm6KI-pauA0HJUYg8e-4B_gWamKsHHrpA0OI0KnaNn1bbp1L8XieKdHkmA9-frrFVcqI Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: e511252cd28247069d96b2378a31f23c Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesNegativeTest-1905947698 Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:37:26.838055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:37:26.839619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e511252cd28247069d96b2378a31f23c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e511252cd28247069d96b2378a31f23c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e511252cd28247069d96b2378a31f23c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e511252cd28247069d96b2378a31f23c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:26.839619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-VolumesNegativeTest-1905947698 Oct 17 04:37:26.839619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: e511252cd28247069d96b2378a31f23c Oct 17 04:37:26.839619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesNegativeTest-1905947698 Oct 17 04:37:26.839619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-VolumesNegativeTest-1905947698-project Oct 17 04:37:26.839619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:37:26.839619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:37:26.839619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: b2fa47a03e3d4735bb497535160c6ffc Oct 17 04:37:26.839619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-VolumesNegativeTest-1905947698-project Oct 17 04:37:26.839619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Oct 17 04:37:26.839619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-53399567", "metadata": {"Type": "work"}}} Oct 17 04:37:26.839619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: Oct 17 04:37:26.839619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-53399567', 'metadata': {'Type': 'work'}}}} Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise error Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi '0' Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:26.840582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:26.843013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 04:37:26.843013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 04:37:26.843013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:26.843013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:26.843013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 04:37:26.843013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 04:37:26.843013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 04:37:26.843013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 04:37:26.843013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 04:37:26.843013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 04:37:26.843013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 04:37:26.843013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.843013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:26.843013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.843013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:26.843013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:26.843013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:26.843013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 04:37:26.843013 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 04:37:26.844350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 04:37:26.844350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.844350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fbe430c1-2293-4673-ae2a-54b989f87f8e tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:26.844350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fbe430c1-2293-4673-ae2a-54b989f87f8e tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010202 Oct 17 04:37:26.844350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 371/755] 10.222.0.40 () {60 vars in 1156 bytes} [Mon Oct 17 04:37:26 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 04:37:26.849632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11ad6b90-af92-48f1-8b81-e09ef37f4ca6 tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] Action: 'create', calling method: .version_select at 0x7fc630c4bd30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1692272334", "metadata": {"Type": "work"}}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11ad6b90-af92-48f1-8b81-e09ef37f4ca6 tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] Request method failure captured: Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 119 Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNwGLhbdWLX9f2VtQu0j9FvCOW83b3AjR_lVvjq28ohOYbb6NgWzIKjAaZh0-KrKNMJYy-Isb-VoeuqN2ry5xeKxSTwdOTIq_rvAP6V4xiLLm6KI-pauA0HJUYg8e-4B_gWamKsHHrpA0OI0KnaNn1bbp1L8XieKdHkmA9-frrFVcqI Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: e511252cd28247069d96b2378a31f23c Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-VolumesNegativeTest-1905947698 Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:37:26.853445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:37:26.854936 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e511252cd28247069d96b2378a31f23c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e511252cd28247069d96b2378a31f23c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e511252cd28247069d96b2378a31f23c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e511252cd28247069d96b2378a31f23c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:26.854936 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-VolumesNegativeTest-1905947698 Oct 17 04:37:26.854936 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: e511252cd28247069d96b2378a31f23c Oct 17 04:37:26.854936 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-VolumesNegativeTest-1905947698 Oct 17 04:37:26.854936 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-VolumesNegativeTest-1905947698-project Oct 17 04:37:26.854936 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:37:26.854936 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:37:26.854936 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: b2fa47a03e3d4735bb497535160c6ffc Oct 17 04:37:26.854936 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-VolumesNegativeTest-1905947698-project Oct 17 04:37:26.854936 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Oct 17 04:37:26.854936 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1692272334", "metadata": {"Type": "work"}}} Oct 17 04:37:26.854936 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: Oct 17 04:37:26.854936 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1692272334', 'metadata': {'Type': 'work'}}}} Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise error Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi '' Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:26.855983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:26.857673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 04:37:26.857673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 04:37:26.857673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:26.857673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:26.857673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 04:37:26.857673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 04:37:26.857673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 04:37:26.857673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 04:37:26.857673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 04:37:26.857673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 04:37:26.857673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 04:37:26.857673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.857673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:26.857673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.857673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:26.857673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:26.857673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:26.857673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 04:37:26.857673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 04:37:26.859116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 04:37:26.859116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.859116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11ad6b90-af92-48f1-8b81-e09ef37f4ca6 tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:26.859116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-11ad6b90-af92-48f1-8b81-e09ef37f4ca6 tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008942 Oct 17 04:37:26.859116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 385/756] 10.222.0.40 () {60 vars in 1156 bytes} [Mon Oct 17 04:37:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 04:37:26.864229 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-060e4299-f48e-4e05-9709-1d1762b3585c tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] Calling method '.version_select at 0x7fc630c843a0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:26.893595 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-060e4299-f48e-4e05-9709-1d1762b3585c tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] HTTP exception thrown: Volume tempest-invalid-841918833 could not be found. Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-060e4299-f48e-4e05-9709-1d1762b3585c tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] Request method failure captured: Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-841918833 HTTP/1.1 Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNwGLhbdWLX9f2VtQu0j9FvCOW83b3AjR_lVvjq28ohOYbb6NgWzIKjAaZh0-KrKNMJYy-Isb-VoeuqN2ry5xeKxSTwdOTIq_rvAP6V4xiLLm6KI-pauA0HJUYg8e-4B_gWamKsHHrpA0OI0KnaNn1bbp1L8XieKdHkmA9-frrFVcqI Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: e511252cd28247069d96b2378a31f23c Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesNegativeTest-1905947698 Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:37:26.896766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:37:26.898382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e511252cd28247069d96b2378a31f23c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e511252cd28247069d96b2378a31f23c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e511252cd28247069d96b2378a31f23c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e511252cd28247069d96b2378a31f23c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:26.898382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-VolumesNegativeTest-1905947698 Oct 17 04:37:26.898382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: e511252cd28247069d96b2378a31f23c Oct 17 04:37:26.898382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesNegativeTest-1905947698 Oct 17 04:37:26.898382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-VolumesNegativeTest-1905947698-project Oct 17 04:37:26.898382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:37:26.898382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:37:26.898382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: b2fa47a03e3d4735bb497535160c6ffc Oct 17 04:37:26.898382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-VolumesNegativeTest-1905947698-project Oct 17 04:37:26.898382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: Oct 17 04:37:26.898382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Volume tempest-invalid-841918833 could not be found. Oct 17 04:37:26.898382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': 'tempest-invalid-841918833'} Oct 17 04:37:26.898382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:26.899340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:26.899340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:37:26.899340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:37:26.899340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 04:37:26.899340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 04:37:26.899340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 04:37:26.899340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 04:37:26.899340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 04:37:26.899340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 04:37:26.899340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 04:37:26.899340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 04:37:26.899340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:37:26.899340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:37:26.899340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:37:26.899340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:37:26.899340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-841918833 could not be found. (HTTP 404) (Request-ID: req-3ce5becb-bd0b-4d62-a2ee-4803aed54a54) Oct 17 04:37:26.899340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.899340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:26.899340 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.900908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:26.900908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 04:37:26.900908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 04:37:26.900908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 04:37:26.900908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 04:37:26.900908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 04:37:26.900908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 04:37:26.900908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 04:37:26.900908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 04:37:26.900908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:37:26.900908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:37:26.900908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 04:37:26.900908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 04:37:26.900908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 04:37:26.900908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 04:37:26.900908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 04:37:26.900908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 04:37:26.900908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 04:37:26.900908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-841918833 could not be found. Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:37:26.902648 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-841918833 could not be found. Oct 17 04:37:26.904170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.904170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:26.904170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.904170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:26.904170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:26.904170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:26.904170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:37:26.904170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:37:26.904170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-841918833 could not be found. Oct 17 04:37:26.904170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.904170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-060e4299-f48e-4e05-9709-1d1762b3585c tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] Returning 404 to user: Volume tempest-invalid-841918833 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:26.904170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-060e4299-f48e-4e05-9709-1d1762b3585c tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-841918833" status: 404 len: 98 microversion: 2.1 time: 0.037656 Oct 17 04:37:26.904170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 372/757] 10.222.0.40 () {58 vars in 1215 bytes} [Mon Oct 17 04:37:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-841918833 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 04:37:26.909383 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b6679a88-19a5-436a-ac57-18315ee0757d tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003661 Oct 17 04:37:26.909880 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 386/758] 10.222.0.40 () {58 vars in 1140 bytes} [Mon Oct 17 04:37:26 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 04:37:26.919391 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-21cfc0b2-d768-41e3-a35e-4ddb67aa5821 tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004212 Oct 17 04:37:26.919922 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 373/759] 10.222.0.40 () {58 vars in 1137 bytes} [Mon Oct 17 04:37:26 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 04:37:26.928358 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9bed3b6e-24b1-4d27-8cbe-8bc2b19d9375 tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] Calling method '.version_select at 0x7fc630c4b430>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:26.957597 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-9bed3b6e-24b1-4d27-8cbe-8bc2b19d9375 tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] HTTP exception thrown: Volume b2d9b104-5be6-499b-b48f-a264e08dd674 could not be found. Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9bed3b6e-24b1-4d27-8cbe-8bc2b19d9375 tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] Request method failure captured: Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: DELETE /compute/v2.1/os-volumes/b2d9b104-5be6-499b-b48f-a264e08dd674 HTTP/1.1 Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNwGLhbdWLX9f2VtQu0j9FvCOW83b3AjR_lVvjq28ohOYbb6NgWzIKjAaZh0-KrKNMJYy-Isb-VoeuqN2ry5xeKxSTwdOTIq_rvAP6V4xiLLm6KI-pauA0HJUYg8e-4B_gWamKsHHrpA0OI0KnaNn1bbp1L8XieKdHkmA9-frrFVcqI Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: e511252cd28247069d96b2378a31f23c Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-VolumesNegativeTest-1905947698 Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:37:26.959540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:37:26.961133 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e511252cd28247069d96b2378a31f23c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e511252cd28247069d96b2378a31f23c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e511252cd28247069d96b2378a31f23c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e511252cd28247069d96b2378a31f23c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:26.961133 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-VolumesNegativeTest-1905947698 Oct 17 04:37:26.961133 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: e511252cd28247069d96b2378a31f23c Oct 17 04:37:26.961133 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-VolumesNegativeTest-1905947698 Oct 17 04:37:26.961133 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-VolumesNegativeTest-1905947698-project Oct 17 04:37:26.961133 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:37:26.961133 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:37:26.961133 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: b2fa47a03e3d4735bb497535160c6ffc Oct 17 04:37:26.961133 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-VolumesNegativeTest-1905947698-project Oct 17 04:37:26.961133 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: Oct 17 04:37:26.961133 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Volume b2d9b104-5be6-499b-b48f-a264e08dd674 could not be found. Oct 17 04:37:26.961133 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': 'b2d9b104-5be6-499b-b48f-a264e08dd674'} Oct 17 04:37:26.961133 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:26.962102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:26.962102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:37:26.962102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:37:26.962102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 04:37:26.962102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 04:37:26.962102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 04:37:26.962102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 04:37:26.962102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 04:37:26.962102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 04:37:26.962102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 04:37:26.962102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 04:37:26.962102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:37:26.962102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:37:26.962102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:37:26.962102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:37:26.962102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b2d9b104-5be6-499b-b48f-a264e08dd674 could not be found. (HTTP 404) (Request-ID: req-d3c13b7d-2e47-427a-acc5-2291223ac76c) Oct 17 04:37:26.962102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.962102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:26.962102 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.963264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:26.963264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 04:37:26.963264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 04:37:26.963264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 04:37:26.963264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 04:37:26.963264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 04:37:26.963264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 04:37:26.963264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 04:37:26.963264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 04:37:26.963264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:37:26.963264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:37:26.963264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 04:37:26.963264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 04:37:26.963264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 04:37:26.963264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 04:37:26.963264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 04:37:26.963264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 04:37:26.963264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 04:37:26.963264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 04:37:26.964430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:37:26.964430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:37:26.964430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:37:26.964430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:37:26.964430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b2d9b104-5be6-499b-b48f-a264e08dd674 could not be found. Oct 17 04:37:26.964430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.964430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:26.964430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.964430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:26.964430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:26.964430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:26.964430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:26.964430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:26.964430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 04:37:26.964430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 04:37:26.964430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:26.964430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:26.964430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 04:37:26.964430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:37:26.965896 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b2d9b104-5be6-499b-b48f-a264e08dd674 could not be found. Oct 17 04:37:26.965896 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.965896 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:26.965896 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.965896 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:26.965896 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:26.965896 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:26.965896 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:37:26.965896 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:37:26.965896 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b2d9b104-5be6-499b-b48f-a264e08dd674 could not be found. Oct 17 04:37:26.965896 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:37:26.965896 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9bed3b6e-24b1-4d27-8cbe-8bc2b19d9375 tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] Returning 404 to user: Volume b2d9b104-5be6-499b-b48f-a264e08dd674 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:26.965896 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9bed3b6e-24b1-4d27-8cbe-8bc2b19d9375 tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/b2d9b104-5be6-499b-b48f-a264e08dd674" status: 404 len: 109 microversion: 2.1 time: 0.036277 Oct 17 04:37:26.965896 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 387/760] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Oct 17 04:37:26 2022] DELETE /compute/v2.1/os-volumes/b2d9b104-5be6-499b-b48f-a264e08dd674 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:37:26.970338 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-299d1849-6b23-4be7-8fc2-72c3c34dc80e tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] Calling method '.version_select at 0x7fc630d7b1f0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:26.997177 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-299d1849-6b23-4be7-8fc2-72c3c34dc80e tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] HTTP exception thrown: Volume 2a91c98d-6e85-462d-b3d4-301113611174 could not be found. Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-299d1849-6b23-4be7-8fc2-72c3c34dc80e tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] Request method failure captured: Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: GET /compute/v2.1/os-volumes/2a91c98d-6e85-462d-b3d4-301113611174 HTTP/1.1 Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNwGLhbdWLX9f2VtQu0j9FvCOW83b3AjR_lVvjq28ohOYbb6NgWzIKjAaZh0-KrKNMJYy-Isb-VoeuqN2ry5xeKxSTwdOTIq_rvAP6V4xiLLm6KI-pauA0HJUYg8e-4B_gWamKsHHrpA0OI0KnaNn1bbp1L8XieKdHkmA9-frrFVcqI Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: e511252cd28247069d96b2378a31f23c Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesNegativeTest-1905947698 Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:37:26.999785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:37:27.001398 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e511252cd28247069d96b2378a31f23c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e511252cd28247069d96b2378a31f23c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e511252cd28247069d96b2378a31f23c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e511252cd28247069d96b2378a31f23c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:37:27.001398 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-VolumesNegativeTest-1905947698 Oct 17 04:37:27.001398 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: e511252cd28247069d96b2378a31f23c Oct 17 04:37:27.001398 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesNegativeTest-1905947698 Oct 17 04:37:27.001398 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-VolumesNegativeTest-1905947698-project Oct 17 04:37:27.001398 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:37:27.001398 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:37:27.001398 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: b2fa47a03e3d4735bb497535160c6ffc Oct 17 04:37:27.001398 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-VolumesNegativeTest-1905947698-project Oct 17 04:37:27.001398 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: Oct 17 04:37:27.001398 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Volume 2a91c98d-6e85-462d-b3d4-301113611174 could not be found. Oct 17 04:37:27.001398 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': '2a91c98d-6e85-462d-b3d4-301113611174'} Oct 17 04:37:27.001398 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:37:27.002545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:27.002545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:37:27.002545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:37:27.002545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 04:37:27.002545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 04:37:27.002545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 04:37:27.002545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 04:37:27.002545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 04:37:27.002545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 04:37:27.002545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 04:37:27.002545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 04:37:27.002545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:37:27.002545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:37:27.002545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:37:27.002545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:37:27.002545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a91c98d-6e85-462d-b3d4-301113611174 could not be found. (HTTP 404) (Request-ID: req-48147216-01c7-4234-8c76-b6b4190d2fa1) Oct 17 04:37:27.002545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:27.002545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:27.002545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:27.003992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:27.003992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 04:37:27.003992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 04:37:27.003992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 04:37:27.003992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 04:37:27.003992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 04:37:27.003992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 04:37:27.003992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 04:37:27.003992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 04:37:27.003992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:37:27.003992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:37:27.003992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 04:37:27.003992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 04:37:27.003992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 04:37:27.003992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 04:37:27.003992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 04:37:27.003992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 04:37:27.003992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 04:37:27.003992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 04:37:27.005456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:37:27.005456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:37:27.005456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:37:27.005456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:37:27.005456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a91c98d-6e85-462d-b3d4-301113611174 could not be found. Oct 17 04:37:27.005456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:27.005456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:27.005456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:27.005456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:27.005456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:27.005456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:27.005456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:37:27.005456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:37:27.005456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 04:37:27.005456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 04:37:27.005456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:37:27.005456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:37:27.005456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 04:37:27.005456 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:37:27.006839 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a91c98d-6e85-462d-b3d4-301113611174 could not be found. Oct 17 04:37:27.006839 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:27.006839 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:37:27.006839 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:27.006839 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:37:27.006839 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:37:27.006839 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:37:27.006839 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:37:27.006839 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:37:27.006839 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a91c98d-6e85-462d-b3d4-301113611174 could not be found. Oct 17 04:37:27.006839 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:37:27.006839 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-299d1849-6b23-4be7-8fc2-72c3c34dc80e tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] Returning 404 to user: Volume 2a91c98d-6e85-462d-b3d4-301113611174 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:37:27.006839 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-299d1849-6b23-4be7-8fc2-72c3c34dc80e tempest-VolumesNegativeTest-1905947698 tempest-VolumesNegativeTest-1905947698-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/2a91c98d-6e85-462d-b3d4-301113611174" status: 404 len: 109 microversion: 2.1 time: 0.034607 Oct 17 04:37:27.006839 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 374/761] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Oct 17 04:37:26 2022] GET /compute/v2.1/os-volumes/2a91c98d-6e85-462d-b3d4-301113611174 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:37:27.271298 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a4194b6a-e181-43cd-ab9e-c777839990ce tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] Calling method '.version_select at 0x7fc630cdfc10>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:27.323428 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a4194b6a-e181-43cd-ab9e-c777839990ce tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/55155491-d085-4199-a528-34e3a40d86ab" status: 200 len: 350 microversion: 2.1 time: 0.056845 Oct 17 04:37:27.323996 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 388/762] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Oct 17 04:37:27 2022] GET /compute/v2.1/os-volumes/55155491-d085-4199-a528-34e3a40d86ab => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:37:27.775182 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d2b9a67f-c8f7-4d99-b141-82ae4c732e4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:27.776791 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d2b9a67f-c8f7-4d99-b141-82ae4c732e4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:27.783554 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2b9a67f-c8f7-4d99-b141-82ae4c732e4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:27.784263 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2b9a67f-c8f7-4d99-b141-82ae4c732e4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:27.784701 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2b9a67f-c8f7-4d99-b141-82ae4c732e4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:27.785427 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2b9a67f-c8f7-4d99-b141-82ae4c732e4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:27.785881 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2b9a67f-c8f7-4d99-b141-82ae4c732e4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:27.786306 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d2b9a67f-c8f7-4d99-b141-82ae4c732e4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:27.923718 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d2b9a67f-c8f7-4d99-b141-82ae4c732e4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:27.933052 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d2b9a67f-c8f7-4d99-b141-82ae4c732e4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:27.934593 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d2b9a67f-c8f7-4d99-b141-82ae4c732e4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:27.935992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d2b9a67f-c8f7-4d99-b141-82ae4c732e4d tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1728 microversion: 2.20 time: 0.166174 Oct 17 04:37:27.936656 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 375/763] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:27 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:28.682838 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-958b9569-b20c-433c-8623-ebeb1255efe8 tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] Calling method '.version_select at 0x7fc630c4bca0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:28.734613 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-958b9569-b20c-433c-8623-ebeb1255efe8 tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e06c245c-830b-4f79-af49-969a3ebcc050" status: 200 len: 351 microversion: 2.1 time: 0.055993 Oct 17 04:37:28.735212 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 389/764] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Oct 17 04:37:28 2022] GET /compute/v2.1/os-volumes/e06c245c-830b-4f79-af49-969a3ebcc050 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:37:28.963494 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5a852c35-6b27-4832-ade8-8c15b7c1db2a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:28.964192 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5a852c35-6b27-4832-ade8-8c15b7c1db2a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:28.974485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a852c35-6b27-4832-ade8-8c15b7c1db2a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:28.974970 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a852c35-6b27-4832-ade8-8c15b7c1db2a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:28.975407 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a852c35-6b27-4832-ade8-8c15b7c1db2a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:28.976102 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a852c35-6b27-4832-ade8-8c15b7c1db2a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:28.976553 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a852c35-6b27-4832-ade8-8c15b7c1db2a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:28.976978 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a852c35-6b27-4832-ade8-8c15b7c1db2a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:29.142320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-5a852c35-6b27-4832-ade8-8c15b7c1db2a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:29.150607 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-5a852c35-6b27-4832-ade8-8c15b7c1db2a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:29.152057 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-5a852c35-6b27-4832-ade8-8c15b7c1db2a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:29.153239 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5a852c35-6b27-4832-ade8-8c15b7c1db2a tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1728 microversion: 2.20 time: 0.194242 Oct 17 04:37:29.153825 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 376/765] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:28 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:30.107604 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5d941b77-3b96-47d7-8ade-f01fd01aa5a1 tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] Calling method '.version_select at 0x7fc630cbb9d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:30.155045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5d941b77-3b96-47d7-8ade-f01fd01aa5a1 tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/4b975d8c-5f2c-42d7-ac18-15d86a4676d7" status: 200 len: 351 microversion: 2.1 time: 0.051842 Oct 17 04:37:30.156365 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 390/766] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Oct 17 04:37:30 2022] GET /compute/v2.1/os-volumes/4b975d8c-5f2c-42d7-ac18-15d86a4676d7 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:37:30.168686 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-076bb3ce-f1ca-45e0-b5d4-35012da7b7ab tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] Calling method '.version_select at 0x7fc630c84040>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:30.178069 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ef9d2428-1ba4-4db6-9f92-d37ffec1d704 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:30.178679 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ef9d2428-1ba4-4db6-9f92-d37ffec1d704 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:30.180564 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:37:30.187341 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef9d2428-1ba4-4db6-9f92-d37ffec1d704 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:30.187737 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef9d2428-1ba4-4db6-9f92-d37ffec1d704 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:30.188169 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef9d2428-1ba4-4db6-9f92-d37ffec1d704 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:30.188865 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef9d2428-1ba4-4db6-9f92-d37ffec1d704 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:30.189345 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef9d2428-1ba4-4db6-9f92-d37ffec1d704 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:30.189821 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ef9d2428-1ba4-4db6-9f92-d37ffec1d704 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:30.254237 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-076bb3ce-f1ca-45e0-b5d4-35012da7b7ab tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089136 Oct 17 04:37:30.254938 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 377/767] 10.222.0.40 () {58 vars in 1134 bytes} [Mon Oct 17 04:37:30 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:30.269066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-645583a1-56fa-4c2f-8e38-f49e3161e225 tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] Calling method '.version_select at 0x7fc630d87f70>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:30.322827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-ef9d2428-1ba4-4db6-9f92-d37ffec1d704 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:30.331951 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-ef9d2428-1ba4-4db6-9f92-d37ffec1d704 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:30.333511 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-ef9d2428-1ba4-4db6-9f92-d37ffec1d704 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:30.335416 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ef9d2428-1ba4-4db6-9f92-d37ffec1d704 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1728 microversion: 2.20 time: 0.160692 Oct 17 04:37:30.346755 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 391/768] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:30 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 04:37:30.355679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-645583a1-56fa-4c2f-8e38-f49e3161e225 tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.090773 Oct 17 04:37:30.356373 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 378/769] 10.222.0.40 () {58 vars in 1149 bytes} [Mon Oct 17 04:37:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:37:30.371117 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7b10c661-22b7-4dae-8187-cfae54712a41 tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] Calling method '.version_select at 0x7fc630c4bf70>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:30.457115 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7b10c661-22b7-4dae-8187-cfae54712a41 tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089703 Oct 17 04:37:30.457689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 392/770] 10.222.0.40 () {58 vars in 1134 bytes} [Mon Oct 17 04:37:30 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:37:30.470981 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e59e2770-20b0-4fdd-8f44-6280b182d6fd tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] Calling method '.version_select at 0x7fc630d6cdc0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:30.553354 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e59e2770-20b0-4fdd-8f44-6280b182d6fd tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086025 Oct 17 04:37:30.554129 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 379/771] 10.222.0.40 () {58 vars in 1167 bytes} [Mon Oct 17 04:37:30 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:37:30.568299 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f84a5c1d-107a-4fc0-a173-fcf0eccc154d tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] Calling method '.version_select at 0x7fc630c51280>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:30.658421 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f84a5c1d-107a-4fc0-a173-fcf0eccc154d tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.090822 Oct 17 04:37:30.658421 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 393/772] 10.222.0.40 () {58 vars in 1170 bytes} [Mon Oct 17 04:37:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:37:30.670788 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5658377b-9077-47b6-85c8-9144b82319c9 tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] Calling method '.version_select at 0x7fc630d7bf70>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:30.763246 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5658377b-9077-47b6-85c8-9144b82319c9 tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.096838 Oct 17 04:37:30.763813 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 380/773] 10.222.0.40 () {58 vars in 1155 bytes} [Mon Oct 17 04:37:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:30.777467 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-805696a0-b3d1-4327-b083-bbf353d94bd3 tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] Calling method '.version_select at 0x7fc630c51c10>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:30.861893 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-805696a0-b3d1-4327-b083-bbf353d94bd3 tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088074 Oct 17 04:37:30.862474 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 394/774] 10.222.0.40 () {58 vars in 1188 bytes} [Mon Oct 17 04:37:30 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:37:30.875748 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ad402561-2230-4f06-bae4-9f928dd94b0d tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] Calling method '.version_select at 0x7fc630c843a0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:30.960253 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ad402561-2230-4f06-bae4-9f928dd94b0d tempest-VolumesTestJSON-99297118 tempest-VolumesTestJSON-99297118-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088191 Oct 17 04:37:30.961094 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 381/775] 10.222.0.40 () {58 vars in 1155 bytes} [Mon Oct 17 04:37:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:31.207005 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b54a82eb-a2e7-43df-a625-1ce363324e0d req-a824c7b8-dc66-4570-b97d-93835b206838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58170c9-886a-45c1-9c0e-acfb37fab782", "name": "network-vif-plugged", "status": "completed", "tag": "0c4b79b8-f091-4221-b5d8-ad21adc83468"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:37:31.222501 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b54a82eb-a2e7-43df-a625-1ce363324e0d req-a824c7b8-dc66-4570-b97d-93835b206838 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:31.223242 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b54a82eb-a2e7-43df-a625-1ce363324e0d req-a824c7b8-dc66-4570-b97d-93835b206838 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:31.223860 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b54a82eb-a2e7-43df-a625-1ce363324e0d req-a824c7b8-dc66-4570-b97d-93835b206838 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:31.236555 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b54a82eb-a2e7-43df-a625-1ce363324e0d req-a824c7b8-dc66-4570-b97d-93835b206838 service nova] Creating event network-vif-plugged:0c4b79b8-f091-4221-b5d8-ad21adc83468 for instance e58170c9-886a-45c1-9c0e-acfb37fab782 on hv-cinder-86155 Oct 17 04:37:31.242088 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b54a82eb-a2e7-43df-a625-1ce363324e0d req-a824c7b8-dc66-4570-b97d-93835b206838 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040101 Oct 17 04:37:31.242981 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 395/776] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:37:31.364450 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-dd89fd69-d6ad-4a08-a718-cb8220cccb4c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:31.365108 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-dd89fd69-d6ad-4a08-a718-cb8220cccb4c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:31.367146 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:37:31.373439 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd89fd69-d6ad-4a08-a718-cb8220cccb4c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:31.374694 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd89fd69-d6ad-4a08-a718-cb8220cccb4c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:31.375920 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd89fd69-d6ad-4a08-a718-cb8220cccb4c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:31.376718 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd89fd69-d6ad-4a08-a718-cb8220cccb4c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:31.377509 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd89fd69-d6ad-4a08-a718-cb8220cccb4c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:31.378043 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-dd89fd69-d6ad-4a08-a718-cb8220cccb4c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:31.516546 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-dd89fd69-d6ad-4a08-a718-cb8220cccb4c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:31.524735 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-dd89fd69-d6ad-4a08-a718-cb8220cccb4c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:31.526233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-dd89fd69-d6ad-4a08-a718-cb8220cccb4c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:31.527396 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-dd89fd69-d6ad-4a08-a718-cb8220cccb4c tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1728 microversion: 2.20 time: 0.167497 Oct 17 04:37:31.527964 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 382/777] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:31 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:32.553998 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-702c7d65-e544-4007-bd51-0a64a30b12cf tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:32.555029 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-702c7d65-e544-4007-bd51-0a64a30b12cf tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:32.561050 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-702c7d65-e544-4007-bd51-0a64a30b12cf tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:32.561580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-702c7d65-e544-4007-bd51-0a64a30b12cf tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:32.562226 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-702c7d65-e544-4007-bd51-0a64a30b12cf tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:32.562696 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-702c7d65-e544-4007-bd51-0a64a30b12cf tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:32.563142 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-702c7d65-e544-4007-bd51-0a64a30b12cf tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:32.563560 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-702c7d65-e544-4007-bd51-0a64a30b12cf tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:32.703746 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-702c7d65-e544-4007-bd51-0a64a30b12cf tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:32.711679 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-702c7d65-e544-4007-bd51-0a64a30b12cf tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:32.713228 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-702c7d65-e544-4007-bd51-0a64a30b12cf tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:32.714388 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-702c7d65-e544-4007-bd51-0a64a30b12cf tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1728 microversion: 2.20 time: 0.165107 Oct 17 04:37:32.714926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 396/778] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:32 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:33.739938 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2d9b15c5-4826-4120-956b-377b01b2b883 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:33.740502 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2d9b15c5-4826-4120-956b-377b01b2b883 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:33.747507 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2d9b15c5-4826-4120-956b-377b01b2b883 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:33.748001 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2d9b15c5-4826-4120-956b-377b01b2b883 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:33.748509 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2d9b15c5-4826-4120-956b-377b01b2b883 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:33.749806 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2d9b15c5-4826-4120-956b-377b01b2b883 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:33.750171 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2d9b15c5-4826-4120-956b-377b01b2b883 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:33.750596 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2d9b15c5-4826-4120-956b-377b01b2b883 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:33.877534 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-2d9b15c5-4826-4120-956b-377b01b2b883 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:33.885785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-2d9b15c5-4826-4120-956b-377b01b2b883 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:33.887234 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-2d9b15c5-4826-4120-956b-377b01b2b883 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:33.888386 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2d9b15c5-4826-4120-956b-377b01b2b883 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1728 microversion: 2.20 time: 0.152452 Oct 17 04:37:33.888957 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 383/779] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:33 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:34.913775 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0f09e9d2-5aa2-47ab-9fd1-8ddfee755412 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:34.914389 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0f09e9d2-5aa2-47ab-9fd1-8ddfee755412 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:34.920827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f09e9d2-5aa2-47ab-9fd1-8ddfee755412 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:34.921849 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f09e9d2-5aa2-47ab-9fd1-8ddfee755412 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:34.922464 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f09e9d2-5aa2-47ab-9fd1-8ddfee755412 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:34.923157 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f09e9d2-5aa2-47ab-9fd1-8ddfee755412 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:34.923607 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f09e9d2-5aa2-47ab-9fd1-8ddfee755412 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:34.924029 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f09e9d2-5aa2-47ab-9fd1-8ddfee755412 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:35.055589 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-0f09e9d2-5aa2-47ab-9fd1-8ddfee755412 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:35.064696 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-0f09e9d2-5aa2-47ab-9fd1-8ddfee755412 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:35.066300 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-0f09e9d2-5aa2-47ab-9fd1-8ddfee755412 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:35.067521 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0f09e9d2-5aa2-47ab-9fd1-8ddfee755412 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1728 microversion: 2.20 time: 0.157661 Oct 17 04:37:35.068079 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 397/780] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:34 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:36.093882 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c33084cd-78b5-43b0-bf90-64338f4d6ce4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:36.094492 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c33084cd-78b5-43b0-bf90-64338f4d6ce4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:36.100873 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c33084cd-78b5-43b0-bf90-64338f4d6ce4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:36.101387 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c33084cd-78b5-43b0-bf90-64338f4d6ce4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:36.101820 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c33084cd-78b5-43b0-bf90-64338f4d6ce4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:36.102514 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c33084cd-78b5-43b0-bf90-64338f4d6ce4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:36.102970 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c33084cd-78b5-43b0-bf90-64338f4d6ce4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:36.103397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c33084cd-78b5-43b0-bf90-64338f4d6ce4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:36.237091 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-c33084cd-78b5-43b0-bf90-64338f4d6ce4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:36.245750 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-c33084cd-78b5-43b0-bf90-64338f4d6ce4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:36.247217 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-c33084cd-78b5-43b0-bf90-64338f4d6ce4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:36.248513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c33084cd-78b5-43b0-bf90-64338f4d6ce4 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1728 microversion: 2.20 time: 0.158722 Oct 17 04:37:36.253192 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 384/781] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:36 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:37.276857 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-01a87c8f-fe36-4b7e-8db9-3f26b8565832 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:37.277672 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-01a87c8f-fe36-4b7e-8db9-3f26b8565832 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:37.284513 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01a87c8f-fe36-4b7e-8db9-3f26b8565832 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:37.285000 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01a87c8f-fe36-4b7e-8db9-3f26b8565832 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:37.285471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01a87c8f-fe36-4b7e-8db9-3f26b8565832 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:37.286168 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01a87c8f-fe36-4b7e-8db9-3f26b8565832 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:37.286628 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01a87c8f-fe36-4b7e-8db9-3f26b8565832 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:37.287162 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-01a87c8f-fe36-4b7e-8db9-3f26b8565832 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:37.438431 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-01a87c8f-fe36-4b7e-8db9-3f26b8565832 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:37.447009 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-01a87c8f-fe36-4b7e-8db9-3f26b8565832 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:37.448601 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-01a87c8f-fe36-4b7e-8db9-3f26b8565832 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:37.449837 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-01a87c8f-fe36-4b7e-8db9-3f26b8565832 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1715 microversion: 2.20 time: 0.176875 Oct 17 04:37:37.450423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 398/782] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:37:37 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1715 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:37:45.788382 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9d4779fd-dec8-4286-bbd0-0edeb25f1760 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2079453732", "imageRef": "bf655d8c-fb2f-42ef-a7a7-0386f57b58cf", "flavorRef": "452", "networks": [{"uuid": "d204bf53-e9f0-47db-9eef-9f1a69ee26b7"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:37:45.843394 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-9d4779fd-dec8-4286-bbd0-0edeb25f1760 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] validate_networks() for [('d204bf53-e9f0-47db-9eef-9f1a69ee26b7', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:37:46.192341 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-9d4779fd-dec8-4286-bbd0-0edeb25f1760 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:37:46.192761 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-9d4779fd-dec8-4286-bbd0-0edeb25f1760 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:37:46.193323 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-9d4779fd-dec8-4286-bbd0-0edeb25f1760 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:37:46.193694 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-9d4779fd-dec8-4286-bbd0-0edeb25f1760 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:37:46.194097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-9d4779fd-dec8-4286-bbd0-0edeb25f1760 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:37:46.203035 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d4779fd-dec8-4286-bbd0-0edeb25f1760 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:46.203440 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d4779fd-dec8-4286-bbd0-0edeb25f1760 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:46.204498 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d4779fd-dec8-4286-bbd0-0edeb25f1760 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:46.205254 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d4779fd-dec8-4286-bbd0-0edeb25f1760 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:46.205708 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d4779fd-dec8-4286-bbd0-0edeb25f1760 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:46.206128 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9d4779fd-dec8-4286-bbd0-0edeb25f1760 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:46.212936 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:37:46.226558 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-9d4779fd-dec8-4286-bbd0-0edeb25f1760 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Getting quotas for project 93ea82d88b2c4a7b8bf597bd83a02287. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:37:46.231823 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-9d4779fd-dec8-4286-bbd0-0edeb25f1760 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Getting quotas for user 41bf7dc32577492885ce2892454e53b2 and project 93ea82d88b2c4a7b8bf597bd83a02287. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:37:46.244002 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9d4779fd-dec8-4286-bbd0-0edeb25f1760 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:37:46.246403 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9d4779fd-dec8-4286-bbd0-0edeb25f1760 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf655d8c-fb2f-42ef-a7a7-0386f57b58cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:37:46.291358 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9d4779fd-dec8-4286-bbd0-0edeb25f1760 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506818 Oct 17 04:37:46.295624 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 385/783] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:37:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 04:37:46.303323 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-84b36943-72be-4b38-9507-aba812c30d3a tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:46.303933 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-84b36943-72be-4b38-9507-aba812c30d3a tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:46.358474 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-84b36943-72be-4b38-9507-aba812c30d3a tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:46.365546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-84b36943-72be-4b38-9507-aba812c30d3a tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee" status: 200 len: 1219 microversion: 2.1 time: 0.066021 Oct 17 04:37:46.366129 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 399/784] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:46 2022] GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:47.389151 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c7e354e7-8c62-4598-a7ce-32102e1ac6f4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:47.389718 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c7e354e7-8c62-4598-a7ce-32102e1ac6f4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:47.407894 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7e354e7-8c62-4598-a7ce-32102e1ac6f4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:47.408956 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7e354e7-8c62-4598-a7ce-32102e1ac6f4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:47.409632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7e354e7-8c62-4598-a7ce-32102e1ac6f4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:47.410485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7e354e7-8c62-4598-a7ce-32102e1ac6f4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:47.411149 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7e354e7-8c62-4598-a7ce-32102e1ac6f4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:47.411834 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c7e354e7-8c62-4598-a7ce-32102e1ac6f4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:47.480267 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-c7e354e7-8c62-4598-a7ce-32102e1ac6f4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:47.488998 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c7e354e7-8c62-4598-a7ce-32102e1ac6f4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee" status: 200 len: 1279 microversion: 2.1 time: 0.104414 Oct 17 04:37:47.489619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 386/785] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:47 2022] GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee => generated 1279 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:48.512093 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ea62e35d-e5ed-4f9d-8db2-6631e95f5402 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:48.512710 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ea62e35d-e5ed-4f9d-8db2-6631e95f5402 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:48.518983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=34 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:37:48.521376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea62e35d-e5ed-4f9d-8db2-6631e95f5402 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:48.522168 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea62e35d-e5ed-4f9d-8db2-6631e95f5402 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:48.522614 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea62e35d-e5ed-4f9d-8db2-6631e95f5402 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:48.523325 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea62e35d-e5ed-4f9d-8db2-6631e95f5402 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:48.523781 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea62e35d-e5ed-4f9d-8db2-6631e95f5402 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:48.524599 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ea62e35d-e5ed-4f9d-8db2-6631e95f5402 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:48.668765 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-ea62e35d-e5ed-4f9d-8db2-6631e95f5402 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:48.671385 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-ac6183cc-c157-4b60-b5e7-e2249c38acba req-285ce6e2-932a-455f-865c-6cf0e96c90a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "185422c3-78b7-476c-9028-fdf9d5701bee", "tag": "30c32e91-5672-4956-8612-2055b3abf8d4"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:37:48.680126 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ea62e35d-e5ed-4f9d-8db2-6631e95f5402 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee" status: 200 len: 1319 microversion: 2.1 time: 0.171765 Oct 17 04:37:48.681432 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 400/786] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:48 2022] GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:48.683843 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ac6183cc-c157-4b60-b5e7-e2249c38acba req-285ce6e2-932a-455f-865c-6cf0e96c90a8 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:48.684541 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ac6183cc-c157-4b60-b5e7-e2249c38acba req-285ce6e2-932a-455f-865c-6cf0e96c90a8 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:48.685188 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-ac6183cc-c157-4b60-b5e7-e2249c38acba req-285ce6e2-932a-455f-865c-6cf0e96c90a8 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:48.698708 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-ac6183cc-c157-4b60-b5e7-e2249c38acba req-285ce6e2-932a-455f-865c-6cf0e96c90a8 service nova] Creating event network-changed:30c32e91-5672-4956-8612-2055b3abf8d4 for instance 185422c3-78b7-476c-9028-fdf9d5701bee on hv-cinder-86155 Oct 17 04:37:48.704602 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-ac6183cc-c157-4b60-b5e7-e2249c38acba req-285ce6e2-932a-455f-865c-6cf0e96c90a8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040372 Oct 17 04:37:48.705409 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 387/787] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:37:49.705115 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3cd586da-2e87-4b81-af9b-d18c3fe3a838 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:49.705729 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3cd586da-2e87-4b81-af9b-d18c3fe3a838 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:49.711681 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cd586da-2e87-4b81-af9b-d18c3fe3a838 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:49.712171 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cd586da-2e87-4b81-af9b-d18c3fe3a838 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:49.712608 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cd586da-2e87-4b81-af9b-d18c3fe3a838 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:49.713397 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cd586da-2e87-4b81-af9b-d18c3fe3a838 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:49.713855 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cd586da-2e87-4b81-af9b-d18c3fe3a838 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:49.714281 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3cd586da-2e87-4b81-af9b-d18c3fe3a838 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:49.854057 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-3cd586da-2e87-4b81-af9b-d18c3fe3a838 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:49.862585 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3cd586da-2e87-4b81-af9b-d18c3fe3a838 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee" status: 200 len: 1319 microversion: 2.1 time: 0.162793 Oct 17 04:37:49.863176 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 401/788] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:49 2022] GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:50.887424 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-711efeed-25dd-4ed4-b2eb-9e6d4c529214 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:50.888118 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-711efeed-25dd-4ed4-b2eb-9e6d4c529214 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:50.894594 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-711efeed-25dd-4ed4-b2eb-9e6d4c529214 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:50.895076 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-711efeed-25dd-4ed4-b2eb-9e6d4c529214 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:50.895509 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-711efeed-25dd-4ed4-b2eb-9e6d4c529214 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:50.896187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-711efeed-25dd-4ed4-b2eb-9e6d4c529214 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:50.896636 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-711efeed-25dd-4ed4-b2eb-9e6d4c529214 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:50.897054 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-711efeed-25dd-4ed4-b2eb-9e6d4c529214 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:51.032604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-711efeed-25dd-4ed4-b2eb-9e6d4c529214 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:51.040252 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-711efeed-25dd-4ed4-b2eb-9e6d4c529214 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee" status: 200 len: 1319 microversion: 2.1 time: 0.157515 Oct 17 04:37:51.040823 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 388/789] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:50 2022] GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:52.063323 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-22f3a18b-f539-4fa5-af66-98641baa0f6b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:52.063934 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-22f3a18b-f539-4fa5-af66-98641baa0f6b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:52.070089 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22f3a18b-f539-4fa5-af66-98641baa0f6b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:52.070574 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22f3a18b-f539-4fa5-af66-98641baa0f6b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:52.071011 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22f3a18b-f539-4fa5-af66-98641baa0f6b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:52.071699 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22f3a18b-f539-4fa5-af66-98641baa0f6b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:52.072152 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22f3a18b-f539-4fa5-af66-98641baa0f6b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:52.072575 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-22f3a18b-f539-4fa5-af66-98641baa0f6b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:52.201841 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-22f3a18b-f539-4fa5-af66-98641baa0f6b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:52.210226 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-22f3a18b-f539-4fa5-af66-98641baa0f6b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee" status: 200 len: 1319 microversion: 2.1 time: 0.150829 Oct 17 04:37:52.210824 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 402/790] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:52 2022] GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:53.233017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0520bf27-1894-42c7-9c8a-25cbd6b5ea9c tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:53.233674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0520bf27-1894-42c7-9c8a-25cbd6b5ea9c tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:53.241225 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0520bf27-1894-42c7-9c8a-25cbd6b5ea9c tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:53.241705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0520bf27-1894-42c7-9c8a-25cbd6b5ea9c tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:53.242132 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0520bf27-1894-42c7-9c8a-25cbd6b5ea9c tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:53.242814 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0520bf27-1894-42c7-9c8a-25cbd6b5ea9c tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:53.243260 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0520bf27-1894-42c7-9c8a-25cbd6b5ea9c tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:53.243713 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0520bf27-1894-42c7-9c8a-25cbd6b5ea9c tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:53.371609 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-0520bf27-1894-42c7-9c8a-25cbd6b5ea9c tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:53.379550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0520bf27-1894-42c7-9c8a-25cbd6b5ea9c tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee" status: 200 len: 1319 microversion: 2.1 time: 0.150281 Oct 17 04:37:53.380060 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 389/791] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:53 2022] GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:54.401370 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c5a1b6c8-fa27-4719-9247-fa03affd94a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:54.401988 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c5a1b6c8-fa27-4719-9247-fa03affd94a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:54.408632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5a1b6c8-fa27-4719-9247-fa03affd94a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:54.409142 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5a1b6c8-fa27-4719-9247-fa03affd94a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:54.409584 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5a1b6c8-fa27-4719-9247-fa03affd94a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:54.410276 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5a1b6c8-fa27-4719-9247-fa03affd94a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:54.410736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5a1b6c8-fa27-4719-9247-fa03affd94a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:54.411160 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c5a1b6c8-fa27-4719-9247-fa03affd94a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:54.539364 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c5a1b6c8-fa27-4719-9247-fa03affd94a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:54.546952 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c5a1b6c8-fa27-4719-9247-fa03affd94a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee" status: 200 len: 1319 microversion: 2.1 time: 0.149397 Oct 17 04:37:54.548027 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 403/792] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:54 2022] GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:55.569751 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6339c985-d6c5-470a-b732-e83b16460049 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:55.570359 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6339c985-d6c5-470a-b732-e83b16460049 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:55.577047 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6339c985-d6c5-470a-b732-e83b16460049 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:55.577799 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6339c985-d6c5-470a-b732-e83b16460049 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:55.578233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6339c985-d6c5-470a-b732-e83b16460049 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:55.579393 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6339c985-d6c5-470a-b732-e83b16460049 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:55.579842 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6339c985-d6c5-470a-b732-e83b16460049 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:55.580262 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6339c985-d6c5-470a-b732-e83b16460049 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:55.704922 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-6339c985-d6c5-470a-b732-e83b16460049 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:55.712750 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6339c985-d6c5-470a-b732-e83b16460049 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee" status: 200 len: 1319 microversion: 2.1 time: 0.146844 Oct 17 04:37:55.713345 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 390/793] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:55 2022] GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:56.122903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-071e6fd8-f99f-40ee-aafd-54ae0d4c174d req-787376cc-5490-4e1f-9a22-0714dcba774d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185422c3-78b7-476c-9028-fdf9d5701bee", "name": "network-vif-plugged", "status": "completed", "tag": "30c32e91-5672-4956-8612-2055b3abf8d4"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:37:56.136562 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-071e6fd8-f99f-40ee-aafd-54ae0d4c174d req-787376cc-5490-4e1f-9a22-0714dcba774d service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:56.137217 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-071e6fd8-f99f-40ee-aafd-54ae0d4c174d req-787376cc-5490-4e1f-9a22-0714dcba774d service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:56.137633 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-071e6fd8-f99f-40ee-aafd-54ae0d4c174d req-787376cc-5490-4e1f-9a22-0714dcba774d service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:56.151063 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-071e6fd8-f99f-40ee-aafd-54ae0d4c174d req-787376cc-5490-4e1f-9a22-0714dcba774d service nova] Creating event network-vif-plugged:30c32e91-5672-4956-8612-2055b3abf8d4 for instance 185422c3-78b7-476c-9028-fdf9d5701bee on hv-cinder-86155 Oct 17 04:37:56.156657 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-071e6fd8-f99f-40ee-aafd-54ae0d4c174d req-787376cc-5490-4e1f-9a22-0714dcba774d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038203 Oct 17 04:37:56.157968 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 404/794] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:37:56.736368 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d890a006-e544-471d-a642-792f5152c0a8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:56.736981 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d890a006-e544-471d-a642-792f5152c0a8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:56.738935 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:37:56.739603 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:37:56.746640 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d890a006-e544-471d-a642-792f5152c0a8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:56.747120 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d890a006-e544-471d-a642-792f5152c0a8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:56.747553 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d890a006-e544-471d-a642-792f5152c0a8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:56.748244 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d890a006-e544-471d-a642-792f5152c0a8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:56.748719 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d890a006-e544-471d-a642-792f5152c0a8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:56.749167 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d890a006-e544-471d-a642-792f5152c0a8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:56.879420 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d890a006-e544-471d-a642-792f5152c0a8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:56.886914 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d890a006-e544-471d-a642-792f5152c0a8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee" status: 200 len: 1319 microversion: 2.1 time: 0.155018 Oct 17 04:37:56.887482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 391/795] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:56 2022] GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:37:57.907249 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:37:57.912145 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-06cf27f4-76a6-4a38-8aa0-48af74e02bf3 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:37:57.913046 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-06cf27f4-76a6-4a38-8aa0-48af74e02bf3 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:37:57.920083 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06cf27f4-76a6-4a38-8aa0-48af74e02bf3 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:57.920553 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06cf27f4-76a6-4a38-8aa0-48af74e02bf3 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:57.920980 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06cf27f4-76a6-4a38-8aa0-48af74e02bf3 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:57.921689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06cf27f4-76a6-4a38-8aa0-48af74e02bf3 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:37:57.922164 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06cf27f4-76a6-4a38-8aa0-48af74e02bf3 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:37:57.922711 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-06cf27f4-76a6-4a38-8aa0-48af74e02bf3 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:37:58.055208 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-06cf27f4-76a6-4a38-8aa0-48af74e02bf3 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:37:58.064009 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-06cf27f4-76a6-4a38-8aa0-48af74e02bf3 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee" status: 200 len: 1507 microversion: 2.1 time: 0.158162 Oct 17 04:37:58.064586 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 405/796] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:37:57 2022] GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:38:14.343555 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-33502615-1e59-4364-8e08-dfe9b3bf3e88 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6abb0930-5ae5-441f-9c5f-77cfc08848b8", "device": "/dev/sdb"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:38:14.347063 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-33502615-1e59-4364-8e08-dfe9b3bf3e88 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:14.349479 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:38:14.350672 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=33 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:38:14.358194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33502615-1e59-4364-8e08-dfe9b3bf3e88 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:14.358690 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33502615-1e59-4364-8e08-dfe9b3bf3e88 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:14.359135 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33502615-1e59-4364-8e08-dfe9b3bf3e88 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:14.359851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33502615-1e59-4364-8e08-dfe9b3bf3e88 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:14.360310 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33502615-1e59-4364-8e08-dfe9b3bf3e88 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:14.360736 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-33502615-1e59-4364-8e08-dfe9b3bf3e88 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:14.633843 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-33502615-1e59-4364-8e08-dfe9b3bf3e88 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "POST /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294054 Oct 17 04:38:14.634469 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 392/797] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Oct 17 04:38:14 2022] POST /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:38:17.653536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-92575070-120c-47ad-8a27-747d35152d57 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:17.655645 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-92575070-120c-47ad-8a27-747d35152d57 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:17.658158 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=25 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:38:17.659891 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=32 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:38:17.666245 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92575070-120c-47ad-8a27-747d35152d57 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:17.666721 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92575070-120c-47ad-8a27-747d35152d57 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:17.667149 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92575070-120c-47ad-8a27-747d35152d57 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:17.667835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92575070-120c-47ad-8a27-747d35152d57 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:17.668280 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92575070-120c-47ad-8a27-747d35152d57 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:17.668699 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-92575070-120c-47ad-8a27-747d35152d57 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:17.698057 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-92575070-120c-47ad-8a27-747d35152d57 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048498 Oct 17 04:38:17.698644 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 406/798] 10.222.0.40 () {60 vars in 1343 bytes} [Mon Oct 17 04:38:17 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:38:17.763431 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-242fa0a8-ca0a-4df6-9f69-14e52a5c382f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:17.764020 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-242fa0a8-ca0a-4df6-9f69-14e52a5c382f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:17.770249 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-242fa0a8-ca0a-4df6-9f69-14e52a5c382f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:17.770734 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-242fa0a8-ca0a-4df6-9f69-14e52a5c382f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:17.771205 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-242fa0a8-ca0a-4df6-9f69-14e52a5c382f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:17.771898 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-242fa0a8-ca0a-4df6-9f69-14e52a5c382f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:17.772355 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-242fa0a8-ca0a-4df6-9f69-14e52a5c382f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:17.772780 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-242fa0a8-ca0a-4df6-9f69-14e52a5c382f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:17.799865 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-242fa0a8-ca0a-4df6-9f69-14e52a5c382f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:38:17.877672 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-242fa0a8-ca0a-4df6-9f69-14e52a5c382f tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 204 len: 0 microversion: 2.20 time: 0.118271 Oct 17 04:38:17.878322 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 393/799] 10.222.0.40 () {60 vars in 1280 bytes} [Mon Oct 17 04:38:17 2022] DELETE /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 04:38:17.886746 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-09a7f7f9-c0a9-425b-8aef-b24e3bb66f56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:17.887887 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-09a7f7f9-c0a9-425b-8aef-b24e3bb66f56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:17.894288 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09a7f7f9-c0a9-425b-8aef-b24e3bb66f56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:17.894773 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09a7f7f9-c0a9-425b-8aef-b24e3bb66f56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:17.895205 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09a7f7f9-c0a9-425b-8aef-b24e3bb66f56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:17.896010 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09a7f7f9-c0a9-425b-8aef-b24e3bb66f56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:17.896446 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09a7f7f9-c0a9-425b-8aef-b24e3bb66f56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:17.896868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-09a7f7f9-c0a9-425b-8aef-b24e3bb66f56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:18.034505 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-09a7f7f9-c0a9-425b-8aef-b24e3bb66f56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:38:18.043242 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-09a7f7f9-c0a9-425b-8aef-b24e3bb66f56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:38:18.044697 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-09a7f7f9-c0a9-425b-8aef-b24e3bb66f56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:38:18.045901 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-09a7f7f9-c0a9-425b-8aef-b24e3bb66f56 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.163348 Oct 17 04:38:18.046445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 407/800] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:38:17 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:38:19.072508 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6a0cba19-24f6-4940-ae36-973a3f753876 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:19.073280 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6a0cba19-24f6-4940-ae36-973a3f753876 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:19.079934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a0cba19-24f6-4940-ae36-973a3f753876 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:19.080436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a0cba19-24f6-4940-ae36-973a3f753876 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:19.080885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a0cba19-24f6-4940-ae36-973a3f753876 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:19.081613 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a0cba19-24f6-4940-ae36-973a3f753876 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:19.082071 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a0cba19-24f6-4940-ae36-973a3f753876 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:19.082499 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a0cba19-24f6-4940-ae36-973a3f753876 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:19.211033 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-6a0cba19-24f6-4940-ae36-973a3f753876 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:38:19.219075 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-6a0cba19-24f6-4940-ae36-973a3f753876 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:38:19.220532 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-6a0cba19-24f6-4940-ae36-973a3f753876 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:38:19.221953 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6a0cba19-24f6-4940-ae36-973a3f753876 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1721 microversion: 2.20 time: 0.153676 Oct 17 04:38:19.222513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 394/801] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:38:19 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:38:20.137428 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-0b3685ce-3b15-4697-a71c-2aa4e0890b6c req-9ad6a0b9-2592-4a48-92a7-f7318bb6ece4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58170c9-886a-45c1-9c0e-acfb37fab782", "name": "network-vif-deleted", "tag": "0c4b79b8-f091-4221-b5d8-ad21adc83468"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:38:20.148062 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0b3685ce-3b15-4697-a71c-2aa4e0890b6c req-9ad6a0b9-2592-4a48-92a7-f7318bb6ece4 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:20.148555 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0b3685ce-3b15-4697-a71c-2aa4e0890b6c req-9ad6a0b9-2592-4a48-92a7-f7318bb6ece4 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:20.149206 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0b3685ce-3b15-4697-a71c-2aa4e0890b6c req-9ad6a0b9-2592-4a48-92a7-f7318bb6ece4 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:20.161631 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-0b3685ce-3b15-4697-a71c-2aa4e0890b6c req-9ad6a0b9-2592-4a48-92a7-f7318bb6ece4 service nova] Creating event network-vif-deleted:0c4b79b8-f091-4221-b5d8-ad21adc83468 for instance e58170c9-886a-45c1-9c0e-acfb37fab782 on hv-cinder-86155 Oct 17 04:38:20.171428 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-0b3685ce-3b15-4697-a71c-2aa4e0890b6c req-9ad6a0b9-2592-4a48-92a7-f7318bb6ece4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037139 Oct 17 04:38:20.172057 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 408/802] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:38:20.248227 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-22aa44e4-a35e-4e5e-9039-acceb2764e95 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:20.249552 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-22aa44e4-a35e-4e5e-9039-acceb2764e95 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:20.256499 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22aa44e4-a35e-4e5e-9039-acceb2764e95 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:20.257335 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22aa44e4-a35e-4e5e-9039-acceb2764e95 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:20.257851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22aa44e4-a35e-4e5e-9039-acceb2764e95 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:20.258794 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22aa44e4-a35e-4e5e-9039-acceb2764e95 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:20.259351 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22aa44e4-a35e-4e5e-9039-acceb2764e95 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:20.259878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22aa44e4-a35e-4e5e-9039-acceb2764e95 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:20.295301 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22aa44e4-a35e-4e5e-9039-acceb2764e95 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:20.296003 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22aa44e4-a35e-4e5e-9039-acceb2764e95 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:20.296608 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-22aa44e4-a35e-4e5e-9039-acceb2764e95 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:20.297294 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-22aa44e4-a35e-4e5e-9039-acceb2764e95 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lazy-loading 'fault' on Instance uuid e58170c9-886a-45c1-9c0e-acfb37fab782 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:38:20.347953 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-22aa44e4-a35e-4e5e-9039-acceb2764e95 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:38:20.358015 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-22aa44e4-a35e-4e5e-9039-acceb2764e95 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:38:20.360808 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-22aa44e4-a35e-4e5e-9039-acceb2764e95 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ea83c1a5d34727943721cd91e7268d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0761fde06e5240adb0d7f1a7d5724d37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:38:20.362784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-22aa44e4-a35e-4e5e-9039-acceb2764e95 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 200 len: 1370 microversion: 2.20 time: 0.118146 Oct 17 04:38:20.363840 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 395/803] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:38:20 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 1370 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 04:38:21.397516 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e1cda0d5-5e2c-4927-b861-e5a9f33b2079 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:21.399196 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e1cda0d5-5e2c-4927-b861-e5a9f33b2079 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:21.406260 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1cda0d5-5e2c-4927-b861-e5a9f33b2079 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:21.407082 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1cda0d5-5e2c-4927-b861-e5a9f33b2079 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:21.407687 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1cda0d5-5e2c-4927-b861-e5a9f33b2079 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:21.408273 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1cda0d5-5e2c-4927-b861-e5a9f33b2079 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:21.409389 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1cda0d5-5e2c-4927-b861-e5a9f33b2079 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:21.409797 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e1cda0d5-5e2c-4927-b861-e5a9f33b2079 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:21.423723 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e1cda0d5-5e2c-4927-b861-e5a9f33b2079 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] HTTP exception thrown: Instance e58170c9-886a-45c1-9c0e-acfb37fab782 could not be found. Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e1cda0d5-5e2c-4927-b861-e5a9f33b2079 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Request method failure captured: Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 HTTP/1.1 Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNqOaNkLUlIe9JkghowX7Loqffk0uxjchW8tNDWNyFdJmXd3HGh7rXAcJtkLn9FF7SIVSDYM5fbILB80s58J2Q8MZXRoIORMxdNY-csEJlqw_o9nEz8wr_KTz2Wpy5BA0EubJr2HuLYBXiLJplJWKFvxE1H0eUuu1cVrLOw3nknNOzA Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: 0761fde06e5240adb0d7f1a7d5724d37 Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-737796925 Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:38:21.426346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:38:21.428022 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:38:21.428022 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeShelveTestJSON-737796925 Oct 17 04:38:21.428022 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: 0761fde06e5240adb0d7f1a7d5724d37 Oct 17 04:38:21.428022 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-737796925 Oct 17 04:38:21.428022 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-AttachVolumeShelveTestJSON-737796925-project Oct 17 04:38:21.428022 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:38:21.428022 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:38:21.428022 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: c7ea83c1a5d34727943721cd91e7268d Oct 17 04:38:21.428022 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeShelveTestJSON-737796925-project Oct 17 04:38:21.428022 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:38:21.428022 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance e58170c9-886a-45c1-9c0e-acfb37fab782 could not be found. Oct 17 04:38:21.428022 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': 'e58170c9-886a-45c1-9c0e-acfb37fab782'} Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58170c9-886a-45c1-9c0e-acfb37fab782 could not be found. Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:38:21.428900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:38:21.430307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:38:21.430307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:38:21.430307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:38:21.430307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:38:21.430307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:38:21.430307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:38:21.430307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:38:21.430307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58170c9-886a-45c1-9c0e-acfb37fab782 could not be found. Oct 17 04:38:21.430307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:21.430307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:21.430307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:21.430307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:21.430307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:21.430307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:21.430307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:38:21.430307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:38:21.430307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58170c9-886a-45c1-9c0e-acfb37fab782 could not be found. Oct 17 04:38:21.430307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:21.431496 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e1cda0d5-5e2c-4927-b861-e5a9f33b2079 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Returning 404 to user: Instance e58170c9-886a-45c1-9c0e-acfb37fab782 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:38:21.431496 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e1cda0d5-5e2c-4927-b861-e5a9f33b2079 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 404 len: 111 microversion: 2.20 time: 0.039574 Oct 17 04:38:21.431496 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 409/804] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:38:21 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 04:38:21.437251 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5cd8a804-c277-428c-8c7a-0373bd209315 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '.version_select at 0x7fc630ccc3a0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:21.459093 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5cd8a804-c277-428c-8c7a-0373bd209315 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-540557241" status: 204 len: 0 microversion: 2.20 time: 0.026004 Oct 17 04:38:21.460142 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 396/805] 10.222.0.40 () {60 vars in 1259 bytes} [Mon Oct 17 04:38:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-540557241 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 04:38:21.847071 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6034a696-164b-4a6f-920e-63614ce4f716 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:21.847579 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6034a696-164b-4a6f-920e-63614ce4f716 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:21.855724 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6034a696-164b-4a6f-920e-63614ce4f716 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:21.856413 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6034a696-164b-4a6f-920e-63614ce4f716 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:21.857021 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6034a696-164b-4a6f-920e-63614ce4f716 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:21.858059 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6034a696-164b-4a6f-920e-63614ce4f716 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:21.858755 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6034a696-164b-4a6f-920e-63614ce4f716 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:21.859371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6034a696-164b-4a6f-920e-63614ce4f716 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:21.896803 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6034a696-164b-4a6f-920e-63614ce4f716 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:38:22.046816 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6034a696-164b-4a6f-920e-63614ce4f716 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 204 len: 0 microversion: 2.1 time: 0.205830 Oct 17 04:38:22.047435 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 410/806] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:38:21 2022] DELETE /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:38:22.066896 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-73b5e4cf-ed7b-46dd-9e49-331b2ffbace6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:22.067694 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-73b5e4cf-ed7b-46dd-9e49-331b2ffbace6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:22.083079 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73b5e4cf-ed7b-46dd-9e49-331b2ffbace6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:22.083640 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73b5e4cf-ed7b-46dd-9e49-331b2ffbace6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:22.084126 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73b5e4cf-ed7b-46dd-9e49-331b2ffbace6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:22.085478 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73b5e4cf-ed7b-46dd-9e49-331b2ffbace6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:22.085987 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73b5e4cf-ed7b-46dd-9e49-331b2ffbace6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:22.086632 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-73b5e4cf-ed7b-46dd-9e49-331b2ffbace6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:22.256571 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-db595f06-1840-4aa8-8786-b96fa9369f52 req-2e78d63b-c8bd-45bd-8a84-9c5474519a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c04fcc98-6f6b-4092-ba63-364498327bb6", "tag": "5018bca9-d0fd-4019-a69a-d25003f4d4da"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:38:22.267061 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-db595f06-1840-4aa8-8786-b96fa9369f52 req-2e78d63b-c8bd-45bd-8a84-9c5474519a82 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:22.267542 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-db595f06-1840-4aa8-8786-b96fa9369f52 req-2e78d63b-c8bd-45bd-8a84-9c5474519a82 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:22.268818 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-db595f06-1840-4aa8-8786-b96fa9369f52 req-2e78d63b-c8bd-45bd-8a84-9c5474519a82 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:22.280876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-db595f06-1840-4aa8-8786-b96fa9369f52 req-2e78d63b-c8bd-45bd-8a84-9c5474519a82 service nova] Creating event network-changed:5018bca9-d0fd-4019-a69a-d25003f4d4da for instance c04fcc98-6f6b-4092-ba63-364498327bb6 on hv-cinder-86155 Oct 17 04:38:22.286611 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-db595f06-1840-4aa8-8786-b96fa9369f52 req-2e78d63b-c8bd-45bd-8a84-9c5474519a82 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.438836 Oct 17 04:38:22.287852 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 397/807] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:38:22.311716 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-73b5e4cf-ed7b-46dd-9e49-331b2ffbace6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:38:22.325195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-73b5e4cf-ed7b-46dd-9e49-331b2ffbace6 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1567 microversion: 2.1 time: 0.270308 Oct 17 04:38:22.326345 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 411/808] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:38:22 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1567 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:38:23.350780 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-277ae7eb-e81f-4328-91f8-60ffee11b9b1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:23.351642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-277ae7eb-e81f-4328-91f8-60ffee11b9b1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:23.358698 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-277ae7eb-e81f-4328-91f8-60ffee11b9b1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:23.359246 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-277ae7eb-e81f-4328-91f8-60ffee11b9b1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:23.359870 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-277ae7eb-e81f-4328-91f8-60ffee11b9b1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:23.361128 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-277ae7eb-e81f-4328-91f8-60ffee11b9b1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:23.361128 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-277ae7eb-e81f-4328-91f8-60ffee11b9b1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:23.361424 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-277ae7eb-e81f-4328-91f8-60ffee11b9b1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:23.500673 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-277ae7eb-e81f-4328-91f8-60ffee11b9b1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:38:23.509063 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-277ae7eb-e81f-4328-91f8-60ffee11b9b1 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1567 microversion: 2.1 time: 0.162942 Oct 17 04:38:23.509669 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 398/809] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:38:23 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:38:23.608976 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1827d5ca-1a69-4dfd-9512-2c9223c3b3d6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:23.610184 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1827d5ca-1a69-4dfd-9512-2c9223c3b3d6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:23.620760 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1827d5ca-1a69-4dfd-9512-2c9223c3b3d6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:23.621277 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1827d5ca-1a69-4dfd-9512-2c9223c3b3d6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:23.622668 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1827d5ca-1a69-4dfd-9512-2c9223c3b3d6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:23.623578 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1827d5ca-1a69-4dfd-9512-2c9223c3b3d6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:23.624145 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1827d5ca-1a69-4dfd-9512-2c9223c3b3d6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:23.624637 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1827d5ca-1a69-4dfd-9512-2c9223c3b3d6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:23.641488 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-1827d5ca-1a69-4dfd-9512-2c9223c3b3d6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] HTTP exception thrown: Instance e58170c9-886a-45c1-9c0e-acfb37fab782 could not be found. Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1827d5ca-1a69-4dfd-9512-2c9223c3b3d6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Request method failure captured: Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 HTTP/1.1 Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNqOaNkLUlIe9JkghowX7Loqffk0uxjchW8tNDWNyFdJmXd3HGh7rXAcJtkLn9FF7SIVSDYM5fbILB80s58J2Q8MZXRoIORMxdNY-csEJlqw_o9nEz8wr_KTz2Wpy5BA0EubJr2HuLYBXiLJplJWKFvxE1H0eUuu1cVrLOw3nknNOzA Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: 0761fde06e5240adb0d7f1a7d5724d37 Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-737796925 Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:38:23.643372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:38:23.644799 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:38:23.644799 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeShelveTestJSON-737796925 Oct 17 04:38:23.644799 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: 0761fde06e5240adb0d7f1a7d5724d37 Oct 17 04:38:23.644799 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-737796925 Oct 17 04:38:23.644799 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-AttachVolumeShelveTestJSON-737796925-project Oct 17 04:38:23.644799 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:38:23.644799 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:38:23.644799 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: c7ea83c1a5d34727943721cd91e7268d Oct 17 04:38:23.644799 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeShelveTestJSON-737796925-project Oct 17 04:38:23.644799 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:38:23.644799 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance e58170c9-886a-45c1-9c0e-acfb37fab782 could not be found. Oct 17 04:38:23.644799 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': 'e58170c9-886a-45c1-9c0e-acfb37fab782'} Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58170c9-886a-45c1-9c0e-acfb37fab782 could not be found. Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:38:23.645647 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58170c9-886a-45c1-9c0e-acfb37fab782 could not be found. Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58170c9-886a-45c1-9c0e-acfb37fab782 could not be found. Oct 17 04:38:23.646979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:23.648207 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1827d5ca-1a69-4dfd-9512-2c9223c3b3d6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Returning 404 to user: Instance e58170c9-886a-45c1-9c0e-acfb37fab782 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:38:23.648207 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1827d5ca-1a69-4dfd-9512-2c9223c3b3d6 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 404 len: 111 microversion: 2.20 time: 0.040058 Oct 17 04:38:23.648207 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 412/810] 10.222.0.40 () {60 vars in 1280 bytes} [Mon Oct 17 04:38:23 2022] DELETE /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 04:38:23.653896 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a3afdae8-359b-4c00-9b62-ea1eff92ccce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:23.654887 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a3afdae8-359b-4c00-9b62-ea1eff92ccce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: e58170c9-886a-45c1-9c0e-acfb37fab782] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:23.662242 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3afdae8-359b-4c00-9b62-ea1eff92ccce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:23.662974 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3afdae8-359b-4c00-9b62-ea1eff92ccce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:23.663603 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3afdae8-359b-4c00-9b62-ea1eff92ccce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:23.664499 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3afdae8-359b-4c00-9b62-ea1eff92ccce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:23.665570 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3afdae8-359b-4c00-9b62-ea1eff92ccce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:23.666167 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a3afdae8-359b-4c00-9b62-ea1eff92ccce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:23.682485 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-a3afdae8-359b-4c00-9b62-ea1eff92ccce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] HTTP exception thrown: Instance e58170c9-886a-45c1-9c0e-acfb37fab782 could not be found. Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a3afdae8-359b-4c00-9b62-ea1eff92ccce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Request method failure captured: Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 HTTP/1.1 Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNqOaNkLUlIe9JkghowX7Loqffk0uxjchW8tNDWNyFdJmXd3HGh7rXAcJtkLn9FF7SIVSDYM5fbILB80s58J2Q8MZXRoIORMxdNY-csEJlqw_o9nEz8wr_KTz2Wpy5BA0EubJr2HuLYBXiLJplJWKFvxE1H0eUuu1cVrLOw3nknNOzA Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: 0761fde06e5240adb0d7f1a7d5724d37 Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-737796925 Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:38:23.684153 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:38:23.685646 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:38:23.685646 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeShelveTestJSON-737796925 Oct 17 04:38:23.685646 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: 0761fde06e5240adb0d7f1a7d5724d37 Oct 17 04:38:23.685646 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-737796925 Oct 17 04:38:23.685646 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-AttachVolumeShelveTestJSON-737796925-project Oct 17 04:38:23.685646 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:38:23.685646 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:38:23.685646 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: c7ea83c1a5d34727943721cd91e7268d Oct 17 04:38:23.685646 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeShelveTestJSON-737796925-project Oct 17 04:38:23.685646 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:38:23.685646 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance e58170c9-886a-45c1-9c0e-acfb37fab782 could not be found. Oct 17 04:38:23.685646 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': 'e58170c9-886a-45c1-9c0e-acfb37fab782'} Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58170c9-886a-45c1-9c0e-acfb37fab782 could not be found. Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:38:23.686397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:38:23.694066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:38:23.694066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:38:23.694066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:38:23.694066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:38:23.694066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:38:23.694066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:38:23.694066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:38:23.694066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58170c9-886a-45c1-9c0e-acfb37fab782 could not be found. Oct 17 04:38:23.694066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:23.694066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:23.694066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:23.694066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:23.694066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:23.694066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:23.694066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:38:23.694066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:38:23.694066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58170c9-886a-45c1-9c0e-acfb37fab782 could not be found. Oct 17 04:38:23.694066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:23.695491 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a3afdae8-359b-4c00-9b62-ea1eff92ccce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Returning 404 to user: Instance e58170c9-886a-45c1-9c0e-acfb37fab782 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:38:23.695491 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a3afdae8-359b-4c00-9b62-ea1eff92ccce tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782" status: 404 len: 111 microversion: 2.20 time: 0.036167 Oct 17 04:38:23.695491 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 399/811] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:38:23 2022] GET /compute/v2.1/servers/e58170c9-886a-45c1-9c0e-acfb37fab782 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 04:38:24.273666 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-b6685312-038c-4aa3-bb84-23ca96209b79 req-1619de2e-c3c7-4864-8de1-21b0663a867d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c04fcc98-6f6b-4092-ba63-364498327bb6", "name": "network-vif-deleted", "tag": "5018bca9-d0fd-4019-a69a-d25003f4d4da"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:38:24.282144 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b6685312-038c-4aa3-bb84-23ca96209b79 req-1619de2e-c3c7-4864-8de1-21b0663a867d service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:24.282626 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b6685312-038c-4aa3-bb84-23ca96209b79 req-1619de2e-c3c7-4864-8de1-21b0663a867d service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:24.283066 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-b6685312-038c-4aa3-bb84-23ca96209b79 req-1619de2e-c3c7-4864-8de1-21b0663a867d service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:24.295253 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-b6685312-038c-4aa3-bb84-23ca96209b79 req-1619de2e-c3c7-4864-8de1-21b0663a867d service nova] Creating event network-vif-deleted:5018bca9-d0fd-4019-a69a-d25003f4d4da for instance c04fcc98-6f6b-4092-ba63-364498327bb6 on hv-cinder-86155 Oct 17 04:38:24.301563 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-b6685312-038c-4aa3-bb84-23ca96209b79 req-1619de2e-c3c7-4864-8de1-21b0663a867d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033570 Oct 17 04:38:24.302253 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 413/812] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:38:24.531654 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-de9cf5cf-21f0-4fbf-954c-4d021f5e2c5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:24.532260 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-de9cf5cf-21f0-4fbf-954c-4d021f5e2c5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:24.542085 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de9cf5cf-21f0-4fbf-954c-4d021f5e2c5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:24.542572 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de9cf5cf-21f0-4fbf-954c-4d021f5e2c5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:24.543006 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de9cf5cf-21f0-4fbf-954c-4d021f5e2c5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:24.543709 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de9cf5cf-21f0-4fbf-954c-4d021f5e2c5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:24.544157 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de9cf5cf-21f0-4fbf-954c-4d021f5e2c5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:24.544578 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-de9cf5cf-21f0-4fbf-954c-4d021f5e2c5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:24.619438 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-de9cf5cf-21f0-4fbf-954c-4d021f5e2c5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d133f6649d4f8b9318b19d1d748f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '164c660f217f4b29b914caf14b773b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:38:24.630545 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-de9cf5cf-21f0-4fbf-954c-4d021f5e2c5f tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 200 len: 1220 microversion: 2.1 time: 0.102633 Oct 17 04:38:24.631124 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 400/813] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:38:24 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:38:24.852210 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebfc72e1-0f6b-4138-a1f4-2d761edf3dcb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:24.853387 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ebfc72e1-0f6b-4138-a1f4-2d761edf3dcb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:24.860596 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebfc72e1-0f6b-4138-a1f4-2d761edf3dcb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:24.861148 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebfc72e1-0f6b-4138-a1f4-2d761edf3dcb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:24.861581 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebfc72e1-0f6b-4138-a1f4-2d761edf3dcb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:24.863238 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebfc72e1-0f6b-4138-a1f4-2d761edf3dcb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:24.863676 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebfc72e1-0f6b-4138-a1f4-2d761edf3dcb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:24.864101 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ebfc72e1-0f6b-4138-a1f4-2d761edf3dcb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:24.878832 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-ebfc72e1-0f6b-4138-a1f4-2d761edf3dcb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] HTTP exception thrown: Instance ee04d43c-6d11-4571-989e-90ee8175e03d could not be found. Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebfc72e1-0f6b-4138-a1f4-2d761edf3dcb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Request method failure captured: Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: DELETE /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d HTTP/1.1 Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNqOaNkLUlIe9JkghowX7Loqffk0uxjchW8tNDWNyFdJmXd3HGh7rXAcJtkLn9FF7SIVSDYM5fbILB80s58J2Q8MZXRoIORMxdNY-csEJlqw_o9nEz8wr_KTz2Wpy5BA0EubJr2HuLYBXiLJplJWKFvxE1H0eUuu1cVrLOw3nknNOzA Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: 0761fde06e5240adb0d7f1a7d5724d37 Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-737796925 Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:38:24.880847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:38:24.883451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:38:24.883451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-AttachVolumeShelveTestJSON-737796925 Oct 17 04:38:24.883451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: 0761fde06e5240adb0d7f1a7d5724d37 Oct 17 04:38:24.883451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-737796925 Oct 17 04:38:24.883451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-AttachVolumeShelveTestJSON-737796925-project Oct 17 04:38:24.883451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:38:24.883451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:38:24.883451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: c7ea83c1a5d34727943721cd91e7268d Oct 17 04:38:24.883451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-AttachVolumeShelveTestJSON-737796925-project Oct 17 04:38:24.883451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:38:24.883451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance ee04d43c-6d11-4571-989e-90ee8175e03d could not be found. Oct 17 04:38:24.883451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': 'ee04d43c-6d11-4571-989e-90ee8175e03d'} Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee04d43c-6d11-4571-989e-90ee8175e03d could not be found. Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:38:24.884532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee04d43c-6d11-4571-989e-90ee8175e03d could not be found. Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee04d43c-6d11-4571-989e-90ee8175e03d could not be found. Oct 17 04:38:24.886471 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:24.888016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ebfc72e1-0f6b-4138-a1f4-2d761edf3dcb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Returning 404 to user: Instance ee04d43c-6d11-4571-989e-90ee8175e03d could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:38:24.888016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ebfc72e1-0f6b-4138-a1f4-2d761edf3dcb tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 404 len: 111 microversion: 2.20 time: 0.035368 Oct 17 04:38:24.888016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 414/814] 10.222.0.40 () {60 vars in 1280 bytes} [Mon Oct 17 04:38:24 2022] DELETE /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 04:38:24.893979 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-061d6536-0f6d-42b6-9b0d-6fcc5a36b210 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:24.894740 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-061d6536-0f6d-42b6-9b0d-6fcc5a36b210 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] [instance: ee04d43c-6d11-4571-989e-90ee8175e03d] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:24.900894 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-061d6536-0f6d-42b6-9b0d-6fcc5a36b210 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:24.901752 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-061d6536-0f6d-42b6-9b0d-6fcc5a36b210 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:24.902042 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-061d6536-0f6d-42b6-9b0d-6fcc5a36b210 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:24.902742 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-061d6536-0f6d-42b6-9b0d-6fcc5a36b210 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:24.903193 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-061d6536-0f6d-42b6-9b0d-6fcc5a36b210 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:24.903665 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-061d6536-0f6d-42b6-9b0d-6fcc5a36b210 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:24.921454 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-061d6536-0f6d-42b6-9b0d-6fcc5a36b210 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] HTTP exception thrown: Instance ee04d43c-6d11-4571-989e-90ee8175e03d could not be found. Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-061d6536-0f6d-42b6-9b0d-6fcc5a36b210 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Request method failure captured: Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d HTTP/1.1 Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNqOaNkLUlIe9JkghowX7Loqffk0uxjchW8tNDWNyFdJmXd3HGh7rXAcJtkLn9FF7SIVSDYM5fbILB80s58J2Q8MZXRoIORMxdNY-csEJlqw_o9nEz8wr_KTz2Wpy5BA0EubJr2HuLYBXiLJplJWKFvxE1H0eUuu1cVrLOw3nknNOzA Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: 0761fde06e5240adb0d7f1a7d5724d37 Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-737796925 Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:38:24.922875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:38:24.925222 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0761fde06e5240adb0d7f1a7d5724d37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:38:24.925222 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-AttachVolumeShelveTestJSON-737796925 Oct 17 04:38:24.925222 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: 0761fde06e5240adb0d7f1a7d5724d37 Oct 17 04:38:24.925222 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-737796925 Oct 17 04:38:24.925222 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-AttachVolumeShelveTestJSON-737796925-project Oct 17 04:38:24.925222 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:38:24.925222 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:38:24.925222 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: c7ea83c1a5d34727943721cd91e7268d Oct 17 04:38:24.925222 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-AttachVolumeShelveTestJSON-737796925-project Oct 17 04:38:24.925222 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:38:24.925222 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance ee04d43c-6d11-4571-989e-90ee8175e03d could not be found. Oct 17 04:38:24.925222 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': 'ee04d43c-6d11-4571-989e-90ee8175e03d'} Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee04d43c-6d11-4571-989e-90ee8175e03d could not be found. Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:38:24.926324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:38:24.928040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:38:24.928040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:38:24.928040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:38:24.928040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:38:24.928040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:38:24.928040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:38:24.928040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:38:24.928040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee04d43c-6d11-4571-989e-90ee8175e03d could not be found. Oct 17 04:38:24.928040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:24.928040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:24.928040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:24.928040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:24.928040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:24.928040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:24.928040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:38:24.928040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:38:24.928040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee04d43c-6d11-4571-989e-90ee8175e03d could not be found. Oct 17 04:38:24.928040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:24.929504 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-061d6536-0f6d-42b6-9b0d-6fcc5a36b210 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] Returning 404 to user: Instance ee04d43c-6d11-4571-989e-90ee8175e03d could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:38:24.929504 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-061d6536-0f6d-42b6-9b0d-6fcc5a36b210 tempest-AttachVolumeShelveTestJSON-737796925 tempest-AttachVolumeShelveTestJSON-737796925-project] 10.222.0.40 "GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d" status: 404 len: 111 microversion: 2.20 time: 0.036767 Oct 17 04:38:24.929504 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 401/815] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Oct 17 04:38:24 2022] GET /compute/v2.1/servers/ee04d43c-6d11-4571-989e-90ee8175e03d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 04:38:25.654262 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e2fc6cfe-3033-4968-a4c2-4e14b6419da4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:25.655816 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e2fc6cfe-3033-4968-a4c2-4e14b6419da4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] [instance: c04fcc98-6f6b-4092-ba63-364498327bb6] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:25.668842 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2fc6cfe-3033-4968-a4c2-4e14b6419da4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:25.669707 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2fc6cfe-3033-4968-a4c2-4e14b6419da4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:25.670162 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2fc6cfe-3033-4968-a4c2-4e14b6419da4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:25.670949 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2fc6cfe-3033-4968-a4c2-4e14b6419da4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:25.671469 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2fc6cfe-3033-4968-a4c2-4e14b6419da4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:25.672192 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e2fc6cfe-3033-4968-a4c2-4e14b6419da4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:25.691076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e2fc6cfe-3033-4968-a4c2-4e14b6419da4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] HTTP exception thrown: Instance c04fcc98-6f6b-4092-ba63-364498327bb6 could not be found. Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e2fc6cfe-3033-4968-a4c2-4e14b6419da4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Request method failure captured: Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 HTTP/1.1 Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNr46A6h37kNQ5AN3JtpcDT6UOeZ3AvDo668uSZQ0ghQF-XVY_AK05jYOkDdZScNz_XcVlbbQH8q7yy5pS-GMEpiSi8apmsBfHE29YdD1TJ1pY-pRIG3Y_HA1q88RdBRbEqBlZ097OAS-0L_WFun970DVkXwzGOVTz3pR0-IPQUOobE Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: 164c660f217f4b29b914caf14b773b61 Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-TestShelveInstance-726996755 Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:38:25.693635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:38:25.695006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/164c660f217f4b29b914caf14b773b61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_164c660f217f4b29b914caf14b773b61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/164c660f217f4b29b914caf14b773b61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/164c660f217f4b29b914caf14b773b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:38:25.695006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-TestShelveInstance-726996755 Oct 17 04:38:25.695006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: 164c660f217f4b29b914caf14b773b61 Oct 17 04:38:25.695006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestShelveInstance-726996755 Oct 17 04:38:25.695006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-TestShelveInstance-726996755-project Oct 17 04:38:25.695006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:38:25.695006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:38:25.695006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: f5d133f6649d4f8b9318b19d1d748f6f Oct 17 04:38:25.695006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-TestShelveInstance-726996755-project Oct 17 04:38:25.695006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:38:25.695006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance c04fcc98-6f6b-4092-ba63-364498327bb6 could not be found. Oct 17 04:38:25.695006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': 'c04fcc98-6f6b-4092-ba63-364498327bb6'} Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c04fcc98-6f6b-4092-ba63-364498327bb6 could not be found. Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:38:25.695811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:38:25.697045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:38:25.697045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:38:25.697045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:38:25.697045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:38:25.697045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:38:25.697045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:38:25.697045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:38:25.697045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c04fcc98-6f6b-4092-ba63-364498327bb6 could not be found. Oct 17 04:38:25.697045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:25.697045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:25.697045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:25.697045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:25.697045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:25.697045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:25.697045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:38:25.697045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:38:25.697045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c04fcc98-6f6b-4092-ba63-364498327bb6 could not be found. Oct 17 04:38:25.697045 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:25.699770 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e2fc6cfe-3033-4968-a4c2-4e14b6419da4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Returning 404 to user: Instance c04fcc98-6f6b-4092-ba63-364498327bb6 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:38:25.699770 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e2fc6cfe-3033-4968-a4c2-4e14b6419da4 tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6" status: 404 len: 111 microversion: 2.1 time: 0.044877 Oct 17 04:38:25.700295 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 415/816] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:38:25 2022] GET /compute/v2.1/servers/c04fcc98-6f6b-4092-ba63-364498327bb6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:38:25.877950 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7bc87b7f-6732-4261-bcf1-7b3f1cd88bce tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] Calling method '.version_select at 0x7fc630c5c550>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:25.913517 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7bc87b7f-6732-4261-bcf1-7b3f1cd88bce tempest-TestShelveInstance-726996755 tempest-TestShelveInstance-726996755-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1420702188" status: 202 len: 0 microversion: 2.1 time: 0.039524 Oct 17 04:38:25.914519 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 402/817] 10.222.0.40 () {58 vars in 1254 bytes} [Mon Oct 17 04:38:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1420702188 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:38:31.230015 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-745ec9a5-cf38-49b0-9e1c-4298c80170a4 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Action: 'create', calling method: .version_select at 0x7fc630c0bf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-839125015"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:38:31.553335 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-745ec9a5-cf38-49b0-9e1c-4298c80170a4 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.445222 Oct 17 04:38:31.557611 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 416/818] 10.222.0.40 () {60 vars in 1155 bytes} [Mon Oct 17 04:38:31 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 450 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 17 04:38:31.568337 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6463b70c-d1d3-4b73-b791-436ec57a8f0c tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Calling method '.version_select at 0x7fc630d5e160>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:31.637827 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6463b70c-d1d3-4b73-b791-436ec57a8f0c tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5234435a-f9bd-4a79-be5e-3c68a71602c2" status: 200 len: 344 microversion: 2.1 time: 0.074754 Oct 17 04:38:31.645588 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 403/819] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Oct 17 04:38:31 2022] GET /compute/v2.1/os-volumes/5234435a-f9bd-4a79-be5e-3c68a71602c2 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:38:32.652919 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8ca9408c-ce84-428e-baf2-d21ffb7e29ec tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Calling method '.version_select at 0x7fc630cdf430>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:32.745681 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8ca9408c-ce84-428e-baf2-d21ffb7e29ec tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5234435a-f9bd-4a79-be5e-3c68a71602c2" status: 200 len: 345 microversion: 2.1 time: 0.097678 Oct 17 04:38:32.746277 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 417/820] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Oct 17 04:38:32 2022] GET /compute/v2.1/os-volumes/5234435a-f9bd-4a79-be5e-3c68a71602c2 => generated 345 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:38:32.761061 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8d73de58-5d51-46ec-9072-4d54950e7533 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Action: 'create', calling method: .version_select at 0x7fc630ccc310>, body: {"snapshot": {"volume_id": "5234435a-f9bd-4a79-be5e-3c68a71602c2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2033763290"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:38:33.000093 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8d73de58-5d51-46ec-9072-4d54950e7533 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.243249 Oct 17 04:38:33.001063 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 404/821] 10.222.0.40 () {60 vars in 1162 bytes} [Mon Oct 17 04:38:32 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:38:33.014084 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3864661b-1f0b-4fb1-84fd-07504a2dbfe1 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Calling method '.version_select at 0x7fc630c51ee0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:33.070118 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3864661b-1f0b-4fb1-84fd-07504a2dbfe1 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8" status: 200 len: 287 microversion: 2.1 time: 0.059750 Oct 17 04:38:33.071013 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 418/822] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Oct 17 04:38:33 2022] GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:38:33.082936 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5d3cd14d-b429-4883-acaf-9c45e2e9b565 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Calling method '.version_select at 0x7fc630cd6b80>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:33.149151 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5d3cd14d-b429-4883-acaf-9c45e2e9b565 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.070290 Oct 17 04:38:33.149729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 405/823] 10.222.0.40 () {58 vars in 1140 bytes} [Mon Oct 17 04:38:33 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:38:33.163868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-00a70a35-bc91-41ec-8ad0-270439939847 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Calling method '.version_select at 0x7fc630cffdc0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:33.204378 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-00a70a35-bc91-41ec-8ad0-270439939847 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8" status: 200 len: 287 microversion: 2.1 time: 0.046173 Oct 17 04:38:33.205684 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 419/824] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Oct 17 04:38:33 2022] GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:38:34.220452 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-23a97d80-cfe8-4ee7-b587-bd45638e7dbb tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Calling method '.version_select at 0x7fc630d7b1f0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:34.269258 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-23a97d80-cfe8-4ee7-b587-bd45638e7dbb tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8" status: 200 len: 287 microversion: 2.1 time: 0.055102 Oct 17 04:38:34.277256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 406/825] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Oct 17 04:38:34 2022] GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:38:35.283830 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-57bcb5ae-87e4-4212-bea4-a450eba5195a tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Calling method '.version_select at 0x7fc630c8a9d0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:35.313282 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-57bcb5ae-87e4-4212-bea4-a450eba5195a tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8" status: 200 len: 287 microversion: 2.1 time: 0.034235 Oct 17 04:38:35.313860 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 420/826] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Oct 17 04:38:35 2022] GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:38:36.323565 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:38:36.324878 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:38:36.329646 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d472b571-15d9-4862-adf5-19556706b36a tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Calling method '.version_select at 0x7fc630c5ca60>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:36.363897 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d472b571-15d9-4862-adf5-19556706b36a tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8" status: 200 len: 287 microversion: 2.1 time: 0.041224 Oct 17 04:38:36.364473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 407/827] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Oct 17 04:38:36 2022] GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:38:37.377991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0aa59d23-8bc7-4da1-9d10-e757b2ea9502 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Calling method '.version_select at 0x7fc630c0f3a0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:37.385354 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:38:37.386623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:38:37.418310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0aa59d23-8bc7-4da1-9d10-e757b2ea9502 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8" status: 200 len: 287 microversion: 2.1 time: 0.045146 Oct 17 04:38:37.419198 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 421/828] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Oct 17 04:38:37 2022] GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:38:38.432097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7c93538f-57bd-4ed0-b306-bb58f8801c6a tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Calling method '.version_select at 0x7fc630c84af0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:38.465189 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7c93538f-57bd-4ed0-b306-bb58f8801c6a tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8" status: 200 len: 287 microversion: 2.1 time: 0.037229 Oct 17 04:38:38.470420 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 408/829] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Oct 17 04:38:38 2022] GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:38:39.478523 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-aaa93142-5793-417e-a1c1-c9d3e06092c3 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Calling method '.version_select at 0x7fc630ee2b80>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:39.512963 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-aaa93142-5793-417e-a1c1-c9d3e06092c3 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8" status: 200 len: 288 microversion: 2.1 time: 0.038682 Oct 17 04:38:39.513693 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 422/830] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Oct 17 04:38:39 2022] GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8 => generated 288 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:38:39.525993 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8b5acdf9-2702-4df9-8a1e-b50b5597e50c tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Calling method '.version_select at 0x7fc630d873a0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:39.627591 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8b5acdf9-2702-4df9-8a1e-b50b5597e50c tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8" status: 202 len: 0 microversion: 2.1 time: 0.105489 Oct 17 04:38:39.628603 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 409/831] 10.222.0.40 () {58 vars in 1254 bytes} [Mon Oct 17 04:38:39 2022] DELETE /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:38:39.637998 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4d20414d-b1a0-4ab9-bf8b-8eb13f362ff6 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Calling method '.version_select at 0x7fc630c0fe50>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:39.698311 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4d20414d-b1a0-4ab9-bf8b-8eb13f362ff6 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8" status: 200 len: 287 microversion: 2.1 time: 0.063323 Oct 17 04:38:39.699086 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 423/832] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Oct 17 04:38:39 2022] GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:38:40.713451 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a4a38884-4e87-49d2-9c96-b6fc7a02a5c0 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Calling method '.version_select at 0x7fc630c5c700>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:40.742737 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-a4a38884-4e87-49d2-9c96-b6fc7a02a5c0 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] HTTP exception thrown: Snapshot ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8 could not be found. Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a4a38884-4e87-49d2-9c96-b6fc7a02a5c0 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Request method failure captured: Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8 HTTP/1.1 Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNxHIlulBx-LTWEav1bUJIQoGJ7YKENjNMWjqxSQqhldYg96EQPkv9ZJ-8cNNQEJNDqTskSJsV4mUHYwMVcd7_C7CENUkq_lBnGrlwkPcgjmnb_ztsir_jBrL7BXJkrdAS2WS7fM6SNcRg4BveyeXPMbmQigM7o_Po1jZHlBNuCJm8A Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: 849dea95a2a24460b879d0dcf1eeb76c Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2136259600 Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:38:40.744999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:38:40.746442 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/849dea95a2a24460b879d0dcf1eeb76c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_849dea95a2a24460b879d0dcf1eeb76c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/849dea95a2a24460b879d0dcf1eeb76c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/849dea95a2a24460b879d0dcf1eeb76c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:38:40.746442 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2136259600 Oct 17 04:38:40.746442 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: 849dea95a2a24460b879d0dcf1eeb76c Oct 17 04:38:40.746442 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2136259600 Oct 17 04:38:40.746442 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-VolumesSnapshotsTestJSON-2136259600-project Oct 17 04:38:40.746442 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:38:40.746442 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:38:40.746442 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: 77c2f000cc2e41218c8e5d0a94271fc6 Oct 17 04:38:40.746442 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2136259600-project Oct 17 04:38:40.746442 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: Oct 17 04:38:40.746442 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Snapshot ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8 could not be found. Oct 17 04:38:40.746442 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': 'ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8'} Oct 17 04:38:40.746442 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:38:40.747278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:40.747278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 04:38:40.747278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 04:38:40.747278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 04:38:40.747278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 04:38:40.747278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 04:38:40.747278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 04:38:40.747278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 04:38:40.747278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 04:38:40.747278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 04:38:40.747278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 04:38:40.747278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:38:40.747278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:38:40.747278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:38:40.747278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:38:40.747278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8 could not be found. (HTTP 404) (Request-ID: req-c1781193-85e5-4291-8480-69a3cf995454) Oct 17 04:38:40.747278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:40.747278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:40.748419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:40.748419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:40.748419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 17 04:38:40.748419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 17 04:38:40.748419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 04:38:40.748419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 04:38:40.748419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 17 04:38:40.748419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 17 04:38:40.748419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 04:38:40.748419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 04:38:40.748419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 04:38:40.748419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 04:38:40.748419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 04:38:40.748419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 04:38:40.748419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 04:38:40.748419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 04:38:40.748419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 04:38:40.748419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 04:38:40.748419 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8 could not be found. Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 17 04:38:40.749642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:38:40.750979 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8 could not be found. Oct 17 04:38:40.750979 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:40.750979 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:40.750979 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:40.750979 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:40.750979 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:40.750979 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:40.750979 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:38:40.750979 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:38:40.750979 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8 could not be found. Oct 17 04:38:40.750979 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:40.750979 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a4a38884-4e87-49d2-9c96-b6fc7a02a5c0 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Returning 404 to user: Snapshot ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:38:40.750979 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a4a38884-4e87-49d2-9c96-b6fc7a02a5c0 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8" status: 404 len: 111 microversion: 2.1 time: 0.037841 Oct 17 04:38:40.752462 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 410/833] 10.222.0.40 () {58 vars in 1251 bytes} [Mon Oct 17 04:38:40 2022] GET /compute/v2.1/os-snapshots/ff6354ef-7bb2-42e6-b49d-9a1aeb5824e8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:38:40.758029 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-211c22dc-0126-4a8d-88f9-8f9add0c15bb tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Calling method '.version_select at 0x7fc630c2b160>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:40.830951 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-211c22dc-0126-4a8d-88f9-8f9add0c15bb tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/5234435a-f9bd-4a79-be5e-3c68a71602c2" status: 202 len: 0 microversion: 2.1 time: 0.079107 Oct 17 04:38:40.831701 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 424/834] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Oct 17 04:38:40 2022] DELETE /compute/v2.1/os-volumes/5234435a-f9bd-4a79-be5e-3c68a71602c2 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 04:38:40.839690 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-02623b8b-fbbe-4de6-bd4c-1998346555c5 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Calling method '.version_select at 0x7fc630d64550>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:40.894441 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-02623b8b-fbbe-4de6-bd4c-1998346555c5 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5234435a-f9bd-4a79-be5e-3c68a71602c2" status: 200 len: 344 microversion: 2.1 time: 0.058529 Oct 17 04:38:40.895011 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 411/835] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Oct 17 04:38:40 2022] GET /compute/v2.1/os-volumes/5234435a-f9bd-4a79-be5e-3c68a71602c2 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:38:41.249443 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-786968e1-3786-48d5-97b6-107c8c8cdee2 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:41.250027 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-786968e1-3786-48d5-97b6-107c8c8cdee2 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:41.257884 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-786968e1-3786-48d5-97b6-107c8c8cdee2 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:41.259980 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-786968e1-3786-48d5-97b6-107c8c8cdee2 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:41.260313 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-786968e1-3786-48d5-97b6-107c8c8cdee2 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:41.261349 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-786968e1-3786-48d5-97b6-107c8c8cdee2 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:41.262100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-786968e1-3786-48d5-97b6-107c8c8cdee2 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:41.262532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-786968e1-3786-48d5-97b6-107c8c8cdee2 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:41.370711 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-786968e1-3786-48d5-97b6-107c8c8cdee2 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lazy-loading 'services' on Instance uuid 185422c3-78b7-476c-9028-fdf9d5701bee {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:38:41.471513 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-786968e1-3786-48d5-97b6-107c8c8cdee2 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "DELETE /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee/os-volume_attachments/6abb0930-5ae5-441f-9c5f-77cfc08848b8" status: 202 len: 0 microversion: 2.1 time: 0.226292 Oct 17 04:38:41.472427 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 425/836] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Oct 17 04:38:41 2022] DELETE /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee/os-volume_attachments/6abb0930-5ae5-441f-9c5f-77cfc08848b8 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:38:41.909970 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-954af3b5-6b8d-4c81-966b-78a4237f18bc tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Calling method '.version_select at 0x7fc630c841f0>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:41.941646 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-954af3b5-6b8d-4c81-966b-78a4237f18bc tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] HTTP exception thrown: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-954af3b5-6b8d-4c81-966b-78a4237f18bc tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Request method failure captured: Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: GET /compute/v2.1/os-volumes/5234435a-f9bd-4a79-be5e-3c68a71602c2 HTTP/1.1 Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNxHIlulBx-LTWEav1bUJIQoGJ7YKENjNMWjqxSQqhldYg96EQPkv9ZJ-8cNNQEJNDqTskSJsV4mUHYwMVcd7_C7CENUkq_lBnGrlwkPcgjmnb_ztsir_jBrL7BXJkrdAS2WS7fM6SNcRg4BveyeXPMbmQigM7o_Po1jZHlBNuCJm8A Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: 849dea95a2a24460b879d0dcf1eeb76c Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2136259600 Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:38:41.953930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:38:41.955767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/849dea95a2a24460b879d0dcf1eeb76c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_849dea95a2a24460b879d0dcf1eeb76c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/849dea95a2a24460b879d0dcf1eeb76c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/849dea95a2a24460b879d0dcf1eeb76c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:38:41.955767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2136259600 Oct 17 04:38:41.955767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: 849dea95a2a24460b879d0dcf1eeb76c Oct 17 04:38:41.955767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2136259600 Oct 17 04:38:41.955767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-VolumesSnapshotsTestJSON-2136259600-project Oct 17 04:38:41.955767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:38:41.955767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:38:41.955767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: 77c2f000cc2e41218c8e5d0a94271fc6 Oct 17 04:38:41.955767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2136259600-project Oct 17 04:38:41.955767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: Oct 17 04:38:41.955767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. Oct 17 04:38:41.955767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': '5234435a-f9bd-4a79-be5e-3c68a71602c2'} Oct 17 04:38:41.955767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:38:41.956784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:41.956784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:38:41.956784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:38:41.956784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 04:38:41.956784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 04:38:41.956784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 04:38:41.956784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 04:38:41.956784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 04:38:41.956784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 04:38:41.956784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 04:38:41.956784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 04:38:41.956784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:38:41.956784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:38:41.956784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:38:41.956784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:38:41.956784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. (HTTP 404) (Request-ID: req-1acb1ec8-99ac-46ca-87b2-742b07a6a46b) Oct 17 04:38:41.956784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:41.956784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:41.956784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:41.958274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:41.958274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 04:38:41.958274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 04:38:41.958274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 04:38:41.958274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 04:38:41.958274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 04:38:41.958274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 04:38:41.958274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 04:38:41.958274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 04:38:41.958274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:38:41.958274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:38:41.958274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 04:38:41.958274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 04:38:41.958274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 04:38:41.958274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 04:38:41.958274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 04:38:41.958274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 04:38:41.958274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 04:38:41.958274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 04:38:41.959679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:38:41.959679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:38:41.959679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:38:41.959679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:38:41.959679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. Oct 17 04:38:41.959679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:41.959679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:41.959679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:41.959679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:41.959679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:41.959679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:41.959679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:38:41.959679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:38:41.959679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 04:38:41.959679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 04:38:41.959679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:38:41.959679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:38:41.959679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 04:38:41.959679 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:38:41.961187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. Oct 17 04:38:41.961187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:41.961187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:41.961187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:41.961187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:41.961187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:41.961187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:41.961187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:38:41.961187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:38:41.961187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. Oct 17 04:38:41.961187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:41.965735 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-954af3b5-6b8d-4c81-966b-78a4237f18bc tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Returning 404 to user: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:38:41.969270 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-954af3b5-6b8d-4c81-966b-78a4237f18bc tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5234435a-f9bd-4a79-be5e-3c68a71602c2" status: 404 len: 109 microversion: 2.1 time: 0.064372 Oct 17 04:38:41.970017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 412/837] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Oct 17 04:38:41 2022] GET /compute/v2.1/os-volumes/5234435a-f9bd-4a79-be5e-3c68a71602c2 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:38:41.986465 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e9447468-8966-4546-a4e4-bf38ea17c843 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Calling method '.version_select at 0x7fc630c2bf70>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:42.027018 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e9447468-8966-4546-a4e4-bf38ea17c843 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] HTTP exception thrown: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e9447468-8966-4546-a4e4-bf38ea17c843 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Request method failure captured: Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: DELETE /compute/v2.1/os-volumes/5234435a-f9bd-4a79-be5e-3c68a71602c2 HTTP/1.1 Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNxHIlulBx-LTWEav1bUJIQoGJ7YKENjNMWjqxSQqhldYg96EQPkv9ZJ-8cNNQEJNDqTskSJsV4mUHYwMVcd7_C7CENUkq_lBnGrlwkPcgjmnb_ztsir_jBrL7BXJkrdAS2WS7fM6SNcRg4BveyeXPMbmQigM7o_Po1jZHlBNuCJm8A Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: 849dea95a2a24460b879d0dcf1eeb76c Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2136259600 Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:38:42.029294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:38:42.030995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/849dea95a2a24460b879d0dcf1eeb76c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_849dea95a2a24460b879d0dcf1eeb76c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/849dea95a2a24460b879d0dcf1eeb76c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/849dea95a2a24460b879d0dcf1eeb76c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:38:42.030995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2136259600 Oct 17 04:38:42.030995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: 849dea95a2a24460b879d0dcf1eeb76c Oct 17 04:38:42.030995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2136259600 Oct 17 04:38:42.030995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-VolumesSnapshotsTestJSON-2136259600-project Oct 17 04:38:42.030995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:38:42.030995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:38:42.030995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 77c2f000cc2e41218c8e5d0a94271fc6 Oct 17 04:38:42.030995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2136259600-project Oct 17 04:38:42.030995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: Oct 17 04:38:42.030995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. Oct 17 04:38:42.030995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': '5234435a-f9bd-4a79-be5e-3c68a71602c2'} Oct 17 04:38:42.030995 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:38:42.031978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:42.031978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:38:42.031978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:38:42.031978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 04:38:42.031978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 04:38:42.031978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 04:38:42.031978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 04:38:42.031978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 04:38:42.031978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 04:38:42.031978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 04:38:42.031978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 04:38:42.031978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:38:42.031978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:38:42.031978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:38:42.031978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:38:42.031978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. (HTTP 404) (Request-ID: req-fb78772d-63c7-40ae-8729-896cd847e434) Oct 17 04:38:42.031978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:42.031978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:42.031978 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:42.033730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:42.033730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 04:38:42.033730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 04:38:42.033730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 04:38:42.033730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 04:38:42.033730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 04:38:42.033730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 04:38:42.033730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 04:38:42.033730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 04:38:42.033730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:38:42.033730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:38:42.033730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 04:38:42.033730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 04:38:42.033730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 04:38:42.033730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 04:38:42.033730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 04:38:42.033730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 04:38:42.033730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 04:38:42.033730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 04:38:42.035136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:38:42.035136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:38:42.035136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:38:42.035136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:38:42.035136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. Oct 17 04:38:42.035136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:42.035136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:42.035136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:42.035136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:42.035136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:42.035136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:42.035136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:38:42.035136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:38:42.035136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 04:38:42.035136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 04:38:42.035136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:38:42.035136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:38:42.035136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 04:38:42.035136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:38:42.036767 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. Oct 17 04:38:42.036767 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:42.036767 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:42.036767 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:42.036767 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:42.036767 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:42.036767 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:42.036767 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:38:42.036767 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:38:42.036767 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. Oct 17 04:38:42.036767 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:38:42.036767 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e9447468-8966-4546-a4e4-bf38ea17c843 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Returning 404 to user: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:38:42.036767 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e9447468-8966-4546-a4e4-bf38ea17c843 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/5234435a-f9bd-4a79-be5e-3c68a71602c2" status: 404 len: 109 microversion: 2.1 time: 0.049943 Oct 17 04:38:42.036767 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 426/838] 10.222.0.40 () {58 vars in 1248 bytes} [Mon Oct 17 04:38:41 2022] DELETE /compute/v2.1/os-volumes/5234435a-f9bd-4a79-be5e-3c68a71602c2 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:38:42.051655 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d3273e0d-552c-411f-9d7a-0ac76a60ae01 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Calling method '.version_select at 0x7fc630cd6670>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:42.101807 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-d3273e0d-552c-411f-9d7a-0ac76a60ae01 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] HTTP exception thrown: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d3273e0d-552c-411f-9d7a-0ac76a60ae01 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Request method failure captured: Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: GET /compute/v2.1/os-volumes/5234435a-f9bd-4a79-be5e-3c68a71602c2 HTTP/1.1 Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNxHIlulBx-LTWEav1bUJIQoGJ7YKENjNMWjqxSQqhldYg96EQPkv9ZJ-8cNNQEJNDqTskSJsV4mUHYwMVcd7_C7CENUkq_lBnGrlwkPcgjmnb_ztsir_jBrL7BXJkrdAS2WS7fM6SNcRg4BveyeXPMbmQigM7o_Po1jZHlBNuCJm8A Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: 849dea95a2a24460b879d0dcf1eeb76c Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2136259600 Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:38:42.104131 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:38:42.105513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/849dea95a2a24460b879d0dcf1eeb76c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_849dea95a2a24460b879d0dcf1eeb76c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/849dea95a2a24460b879d0dcf1eeb76c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/849dea95a2a24460b879d0dcf1eeb76c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:38:42.105513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2136259600 Oct 17 04:38:42.105513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: 849dea95a2a24460b879d0dcf1eeb76c Oct 17 04:38:42.105513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2136259600 Oct 17 04:38:42.105513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-VolumesSnapshotsTestJSON-2136259600-project Oct 17 04:38:42.105513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:38:42.105513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:38:42.105513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: 77c2f000cc2e41218c8e5d0a94271fc6 Oct 17 04:38:42.105513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2136259600-project Oct 17 04:38:42.105513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: Oct 17 04:38:42.105513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. Oct 17 04:38:42.105513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': '5234435a-f9bd-4a79-be5e-3c68a71602c2'} Oct 17 04:38:42.105513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:38:42.106330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:42.106330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:38:42.106330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:38:42.106330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 04:38:42.106330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 04:38:42.106330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 04:38:42.106330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 04:38:42.106330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 04:38:42.106330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 04:38:42.106330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 04:38:42.106330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 04:38:42.106330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:38:42.106330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:38:42.106330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:38:42.106330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:38:42.106330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. (HTTP 404) (Request-ID: req-e0ce3015-034c-47a3-a99a-ad2ca7494046) Oct 17 04:38:42.106330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:42.106330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:42.106330 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:42.107473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:42.107473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 04:38:42.107473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 04:38:42.107473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 04:38:42.107473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 04:38:42.107473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 04:38:42.107473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 04:38:42.107473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 04:38:42.107473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 04:38:42.107473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 04:38:42.107473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 04:38:42.107473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 04:38:42.107473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 04:38:42.107473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 04:38:42.107473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 04:38:42.107473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 04:38:42.107473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 04:38:42.107473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 04:38:42.107473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 04:38:42.109160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 04:38:42.109160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 04:38:42.109160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 04:38:42.109160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 04:38:42.109160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. Oct 17 04:38:42.109160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:42.109160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:42.109160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:42.109160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:42.109160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:42.109160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:42.109160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:38:42.109160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:38:42.109160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 04:38:42.109160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 04:38:42.109160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:38:42.109160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:38:42.109160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 04:38:42.109160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:38:42.110320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. Oct 17 04:38:42.110320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:42.110320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:42.110320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:42.110320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:42.110320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:42.110320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:42.110320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:38:42.110320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:38:42.110320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. Oct 17 04:38:42.110320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:42.110320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d3273e0d-552c-411f-9d7a-0ac76a60ae01 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] Returning 404 to user: Volume 5234435a-f9bd-4a79-be5e-3c68a71602c2 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:38:42.110320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d3273e0d-552c-411f-9d7a-0ac76a60ae01 tempest-VolumesSnapshotsTestJSON-2136259600 tempest-VolumesSnapshotsTestJSON-2136259600-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/5234435a-f9bd-4a79-be5e-3c68a71602c2" status: 404 len: 109 microversion: 2.1 time: 0.063969 Oct 17 04:38:42.110320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 413/839] 10.222.0.40 () {58 vars in 1245 bytes} [Mon Oct 17 04:38:42 2022] GET /compute/v2.1/os-volumes/5234435a-f9bd-4a79-be5e-3c68a71602c2 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:38:42.650585 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-93942c1b-2c29-43a1-932f-2400eb4b7d1e tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:42.652130 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-93942c1b-2c29-43a1-932f-2400eb4b7d1e tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:42.662745 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93942c1b-2c29-43a1-932f-2400eb4b7d1e tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:42.663916 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93942c1b-2c29-43a1-932f-2400eb4b7d1e tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:42.665718 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93942c1b-2c29-43a1-932f-2400eb4b7d1e tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:42.667043 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93942c1b-2c29-43a1-932f-2400eb4b7d1e tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:42.667735 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93942c1b-2c29-43a1-932f-2400eb4b7d1e tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:42.668430 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-93942c1b-2c29-43a1-932f-2400eb4b7d1e tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:42.703371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-93942c1b-2c29-43a1-932f-2400eb4b7d1e tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:38:42.839216 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-93942c1b-2c29-43a1-932f-2400eb4b7d1e tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "DELETE /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee" status: 204 len: 0 microversion: 2.1 time: 0.190995 Oct 17 04:38:42.841097 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 427/840] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:38:42 2022] DELETE /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:38:42.857018 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-05eb9aea-791a-4cb0-94d8-96e0b2f6e847 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:42.857974 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-05eb9aea-791a-4cb0-94d8-96e0b2f6e847 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:42.870295 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05eb9aea-791a-4cb0-94d8-96e0b2f6e847 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:42.870805 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05eb9aea-791a-4cb0-94d8-96e0b2f6e847 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:42.874787 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05eb9aea-791a-4cb0-94d8-96e0b2f6e847 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:42.876288 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05eb9aea-791a-4cb0-94d8-96e0b2f6e847 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:42.878356 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05eb9aea-791a-4cb0-94d8-96e0b2f6e847 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:42.878805 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-05eb9aea-791a-4cb0-94d8-96e0b2f6e847 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:43.154489 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-05eb9aea-791a-4cb0-94d8-96e0b2f6e847 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:38:43.167741 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-05eb9aea-791a-4cb0-94d8-96e0b2f6e847 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee" status: 200 len: 1513 microversion: 2.1 time: 0.321980 Oct 17 04:38:43.168930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 414/841] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:38:42 2022] GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee => generated 1513 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:38:44.199689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-688f3eaa-9ace-4c6f-871f-bf85a29f4813 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:44.200732 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-688f3eaa-9ace-4c6f-871f-bf85a29f4813 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:44.218709 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-688f3eaa-9ace-4c6f-871f-bf85a29f4813 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:44.219530 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-688f3eaa-9ace-4c6f-871f-bf85a29f4813 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:44.221108 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-688f3eaa-9ace-4c6f-871f-bf85a29f4813 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:44.222328 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-688f3eaa-9ace-4c6f-871f-bf85a29f4813 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:44.230973 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-688f3eaa-9ace-4c6f-871f-bf85a29f4813 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:44.231799 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-688f3eaa-9ace-4c6f-871f-bf85a29f4813 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:44.677104 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-688f3eaa-9ace-4c6f-871f-bf85a29f4813 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:38:44.688089 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-688f3eaa-9ace-4c6f-871f-bf85a29f4813 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee" status: 200 len: 1513 microversion: 2.1 time: 0.499921 Oct 17 04:38:44.688869 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 428/842] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:38:44 2022] GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee => generated 1513 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:38:45.550110 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-dda0b63b-578a-4155-89cc-fff0e414e35f req-08fec811-0e88-42f9-b92c-9e17291a48fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185422c3-78b7-476c-9028-fdf9d5701bee", "name": "network-vif-deleted", "tag": "30c32e91-5672-4956-8612-2055b3abf8d4"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:38:45.567441 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-dda0b63b-578a-4155-89cc-fff0e414e35f req-08fec811-0e88-42f9-b92c-9e17291a48fe service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:45.568226 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-dda0b63b-578a-4155-89cc-fff0e414e35f req-08fec811-0e88-42f9-b92c-9e17291a48fe service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:45.569044 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-dda0b63b-578a-4155-89cc-fff0e414e35f req-08fec811-0e88-42f9-b92c-9e17291a48fe service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:45.596449 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-dda0b63b-578a-4155-89cc-fff0e414e35f req-08fec811-0e88-42f9-b92c-9e17291a48fe service nova] Creating event network-vif-deleted:30c32e91-5672-4956-8612-2055b3abf8d4 for instance 185422c3-78b7-476c-9028-fdf9d5701bee on hv-cinder-86155 Oct 17 04:38:45.604369 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-dda0b63b-578a-4155-89cc-fff0e414e35f req-08fec811-0e88-42f9-b92c-9e17291a48fe service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057868 Oct 17 04:38:45.609243 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 415/843] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:38:45.713980 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-703b0d86-cccf-4039-92f4-bc300b3bb635 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:45.715514 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-703b0d86-cccf-4039-92f4-bc300b3bb635 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:45.728455 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-703b0d86-cccf-4039-92f4-bc300b3bb635 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:45.740783 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-703b0d86-cccf-4039-92f4-bc300b3bb635 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:45.742703 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-703b0d86-cccf-4039-92f4-bc300b3bb635 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:45.745341 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-703b0d86-cccf-4039-92f4-bc300b3bb635 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:45.746046 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-703b0d86-cccf-4039-92f4-bc300b3bb635 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:45.747273 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-703b0d86-cccf-4039-92f4-bc300b3bb635 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:45.828662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-703b0d86-cccf-4039-92f4-bc300b3bb635 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:45.835439 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-703b0d86-cccf-4039-92f4-bc300b3bb635 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:45.840564 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-703b0d86-cccf-4039-92f4-bc300b3bb635 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:45.842396 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-703b0d86-cccf-4039-92f4-bc300b3bb635 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lazy-loading 'fault' on Instance uuid 185422c3-78b7-476c-9028-fdf9d5701bee {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:38:45.991245 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-703b0d86-cccf-4039-92f4-bc300b3bb635 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:38:46.052033 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-703b0d86-cccf-4039-92f4-bc300b3bb635 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee" status: 200 len: 1309 microversion: 2.1 time: 0.344192 Oct 17 04:38:46.053424 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 429/844] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:38:45 2022] GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee => generated 1309 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:38:47.075988 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-818a7214-6d8e-4e9f-8a6f-3211468988a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:47.076873 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-818a7214-6d8e-4e9f-8a6f-3211468988a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 185422c3-78b7-476c-9028-fdf9d5701bee] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:47.089666 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-818a7214-6d8e-4e9f-8a6f-3211468988a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:47.090168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-818a7214-6d8e-4e9f-8a6f-3211468988a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:47.090606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-818a7214-6d8e-4e9f-8a6f-3211468988a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:47.093253 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-818a7214-6d8e-4e9f-8a6f-3211468988a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:47.093741 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-818a7214-6d8e-4e9f-8a6f-3211468988a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:47.094180 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-818a7214-6d8e-4e9f-8a6f-3211468988a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:47.125511 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-818a7214-6d8e-4e9f-8a6f-3211468988a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] HTTP exception thrown: Instance 185422c3-78b7-476c-9028-fdf9d5701bee could not be found. Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-818a7214-6d8e-4e9f-8a6f-3211468988a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Request method failure captured: Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee HTTP/1.1 Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNwYReCoH77Al4qXnWNB1UjPp9x-BD5lidB5NV5F0Odw1jiEwjnTgSNzJa4USacL5-VTx6GYfHKSFQVcDktmu4vh_7jzbARcTGneJJ7YSJc9IkSR-BH02OCsjrx1xyo_-Pfu7noipk5HLQVKFBd4oXTHCHNar1Xh8gMbDlgSox9Cu0I Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: 93ea82d88b2c4a7b8bf597bd83a02287 Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesSnapshotTestJSON-401976650 Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:38:47.129774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:38:47.131459 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/93ea82d88b2c4a7b8bf597bd83a02287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_93ea82d88b2c4a7b8bf597bd83a02287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/93ea82d88b2c4a7b8bf597bd83a02287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/93ea82d88b2c4a7b8bf597bd83a02287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:38:47.131459 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-VolumesSnapshotTestJSON-401976650 Oct 17 04:38:47.131459 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: 93ea82d88b2c4a7b8bf597bd83a02287 Oct 17 04:38:47.131459 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-401976650 Oct 17 04:38:47.131459 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-VolumesSnapshotTestJSON-401976650-project Oct 17 04:38:47.131459 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:38:47.131459 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:38:47.131459 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: 41bf7dc32577492885ce2892454e53b2 Oct 17 04:38:47.131459 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-VolumesSnapshotTestJSON-401976650-project Oct 17 04:38:47.131459 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:38:47.131459 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance 185422c3-78b7-476c-9028-fdf9d5701bee could not be found. Oct 17 04:38:47.131459 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': '185422c3-78b7-476c-9028-fdf9d5701bee'} Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 185422c3-78b7-476c-9028-fdf9d5701bee could not be found. Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:38:47.132307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:38:47.135179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:38:47.135179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:38:47.135179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:38:47.135179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:38:47.135179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:38:47.135179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:38:47.135179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:38:47.135179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 185422c3-78b7-476c-9028-fdf9d5701bee could not be found. Oct 17 04:38:47.135179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:47.135179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:38:47.135179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:47.135179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:38:47.135179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:38:47.135179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:38:47.135179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:38:47.135179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:38:47.135179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 185422c3-78b7-476c-9028-fdf9d5701bee could not be found. Oct 17 04:38:47.135179 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:38:47.136953 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-818a7214-6d8e-4e9f-8a6f-3211468988a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Returning 404 to user: Instance 185422c3-78b7-476c-9028-fdf9d5701bee could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:38:47.138030 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-818a7214-6d8e-4e9f-8a6f-3211468988a4 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee" status: 404 len: 111 microversion: 2.1 time: 0.066367 Oct 17 04:38:47.139712 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 416/845] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:38:47 2022] GET /compute/v2.1/servers/185422c3-78b7-476c-9028-fdf9d5701bee => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:38:48.514304 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-9d809ab0-6641-4815-9820-1e38f7c116c1 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Action: 'create', calling method: .version_select at 0x7fc630c51ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-118990177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNxFedvg0PzNzrYiNgLvxWORdxnmNUIDD/I8/0XBoJh0drTEUGx7/GTbmqIyo/JaTPXNeY9tX+TWC1pPXCbvRXy8ZI1+18wHd6t9eKfhCvWBCmxDdrYgBArjkp5a/4vlg=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:38:48.532553 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-9d809ab0-6641-4815-9820-1e38f7c116c1 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Getting quotas for project 84d236da3b7b46f4ab13a096d7d80298. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:38:48.539054 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-9d809ab0-6641-4815-9820-1e38f7c116c1 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Getting quotas for user 2ed9c2a1827b4fc5a916092b30bdec15 and project 84d236da3b7b46f4ab13a096d7d80298. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:38:48.563863 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-9d809ab0-6641-4815-9820-1e38f7c116c1 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.370846 Oct 17 04:38:48.569260 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 430/846] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Oct 17 04:38:48 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:38:55.264461 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2f38fb1f-0faa-4bc6-bcad-ba46269d3fff tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1418731785", "imageRef": "bf655d8c-fb2f-42ef-a7a7-0386f57b58cf", "flavorRef": "452", "networks": [{"uuid": "d204bf53-e9f0-47db-9eef-9f1a69ee26b7"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:38:55.321484 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-2f38fb1f-0faa-4bc6-bcad-ba46269d3fff tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] validate_networks() for [('d204bf53-e9f0-47db-9eef-9f1a69ee26b7', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:38:56.012455 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-2f38fb1f-0faa-4bc6-bcad-ba46269d3fff tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:38:56.012892 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-2f38fb1f-0faa-4bc6-bcad-ba46269d3fff tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:38:56.013519 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-2f38fb1f-0faa-4bc6-bcad-ba46269d3fff tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:38:56.013930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-2f38fb1f-0faa-4bc6-bcad-ba46269d3fff tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:38:56.014469 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-2f38fb1f-0faa-4bc6-bcad-ba46269d3fff tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:38:56.025047 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f38fb1f-0faa-4bc6-bcad-ba46269d3fff tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:56.025773 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f38fb1f-0faa-4bc6-bcad-ba46269d3fff tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:56.026508 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f38fb1f-0faa-4bc6-bcad-ba46269d3fff tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:56.027722 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f38fb1f-0faa-4bc6-bcad-ba46269d3fff tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:56.028210 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f38fb1f-0faa-4bc6-bcad-ba46269d3fff tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:56.028701 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2f38fb1f-0faa-4bc6-bcad-ba46269d3fff tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:56.047659 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-2f38fb1f-0faa-4bc6-bcad-ba46269d3fff tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Getting quotas for project 93ea82d88b2c4a7b8bf597bd83a02287. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:38:56.052619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-2f38fb1f-0faa-4bc6-bcad-ba46269d3fff tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Getting quotas for user 41bf7dc32577492885ce2892454e53b2 and project 93ea82d88b2c4a7b8bf597bd83a02287. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:38:56.063798 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2f38fb1f-0faa-4bc6-bcad-ba46269d3fff tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:38:56.066181 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2f38fb1f-0faa-4bc6-bcad-ba46269d3fff tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf655d8c-fb2f-42ef-a7a7-0386f57b58cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:38:56.115889 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2f38fb1f-0faa-4bc6-bcad-ba46269d3fff tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.855283 Oct 17 04:38:56.116757 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 417/847] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:38:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 04:38:56.139695 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8c7b7ea5-661d-4fe7-92c1-e093a691a09f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:56.140610 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8c7b7ea5-661d-4fe7-92c1-e093a691a09f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:56.143407 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:38:56.206903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-8c7b7ea5-661d-4fe7-92c1-e093a691a09f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:38:56.216860 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8c7b7ea5-661d-4fe7-92c1-e093a691a09f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379" status: 200 len: 1219 microversion: 2.1 time: 0.086018 Oct 17 04:38:56.217494 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 431/848] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:38:56 2022] GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:38:57.244574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-95245ce1-8a5f-4c38-ae72-8b36a255934b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:57.245972 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-95245ce1-8a5f-4c38-ae72-8b36a255934b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:57.254189 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95245ce1-8a5f-4c38-ae72-8b36a255934b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:57.255859 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95245ce1-8a5f-4c38-ae72-8b36a255934b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:57.256833 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95245ce1-8a5f-4c38-ae72-8b36a255934b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:57.258427 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95245ce1-8a5f-4c38-ae72-8b36a255934b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:57.259156 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95245ce1-8a5f-4c38-ae72-8b36a255934b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:57.259812 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-95245ce1-8a5f-4c38-ae72-8b36a255934b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:57.357961 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-95245ce1-8a5f-4c38-ae72-8b36a255934b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:38:57.368584 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-95245ce1-8a5f-4c38-ae72-8b36a255934b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379" status: 200 len: 1279 microversion: 2.1 time: 0.129358 Oct 17 04:38:57.378034 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 418/849] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:38:57 2022] GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379 => generated 1279 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:38:58.393051 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11bfeb50-d129-4ba8-b33e-cd8adb146ca8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:58.393718 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-11bfeb50-d129-4ba8-b33e-cd8adb146ca8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:58.402921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11bfeb50-d129-4ba8-b33e-cd8adb146ca8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:58.403501 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11bfeb50-d129-4ba8-b33e-cd8adb146ca8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:58.403946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11bfeb50-d129-4ba8-b33e-cd8adb146ca8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:58.404653 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11bfeb50-d129-4ba8-b33e-cd8adb146ca8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:58.405126 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11bfeb50-d129-4ba8-b33e-cd8adb146ca8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:58.405555 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11bfeb50-d129-4ba8-b33e-cd8adb146ca8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:58.551728 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-11bfeb50-d129-4ba8-b33e-cd8adb146ca8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:38:58.563656 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-11bfeb50-d129-4ba8-b33e-cd8adb146ca8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379" status: 200 len: 1319 microversion: 2.1 time: 0.174501 Oct 17 04:38:58.564251 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 432/850] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:38:58 2022] GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:38:58.668711 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-82444cf0-849a-4c32-bacf-93b72f36dabc req-f2446deb-1fb5-4064-a540-e02244131367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32ac795f-3972-41bd-b28f-8ddf3990a379", "tag": "4b85bbb5-c664-41f0-b1ec-715507c7f011"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:38:58.681764 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-82444cf0-849a-4c32-bacf-93b72f36dabc req-f2446deb-1fb5-4064-a540-e02244131367 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:58.682243 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-82444cf0-849a-4c32-bacf-93b72f36dabc req-f2446deb-1fb5-4064-a540-e02244131367 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:58.683904 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-82444cf0-849a-4c32-bacf-93b72f36dabc req-f2446deb-1fb5-4064-a540-e02244131367 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:58.699087 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-82444cf0-849a-4c32-bacf-93b72f36dabc req-f2446deb-1fb5-4064-a540-e02244131367 service nova] Creating event network-changed:4b85bbb5-c664-41f0-b1ec-715507c7f011 for instance 32ac795f-3972-41bd-b28f-8ddf3990a379 on hv-cinder-86155 Oct 17 04:38:58.705540 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-82444cf0-849a-4c32-bacf-93b72f36dabc req-f2446deb-1fb5-4064-a540-e02244131367 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041286 Oct 17 04:38:58.707097 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 419/851] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:38:59.588345 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4d82058c-5da3-44c7-bcf3-710e6a5fb000 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:38:59.589023 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4d82058c-5da3-44c7-bcf3-710e6a5fb000 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:38:59.595186 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d82058c-5da3-44c7-bcf3-710e6a5fb000 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:59.595676 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d82058c-5da3-44c7-bcf3-710e6a5fb000 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:59.596117 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d82058c-5da3-44c7-bcf3-710e6a5fb000 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:59.596818 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d82058c-5da3-44c7-bcf3-710e6a5fb000 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:38:59.597427 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d82058c-5da3-44c7-bcf3-710e6a5fb000 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:38:59.598024 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4d82058c-5da3-44c7-bcf3-710e6a5fb000 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:38:59.764518 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-4d82058c-5da3-44c7-bcf3-710e6a5fb000 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:38:59.773167 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4d82058c-5da3-44c7-bcf3-710e6a5fb000 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379" status: 200 len: 1319 microversion: 2.1 time: 0.188830 Oct 17 04:38:59.773751 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 433/852] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:38:59 2022] GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:00.796762 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f296426f-5e13-4a3d-a05b-0844454ddfc0 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:00.797711 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f296426f-5e13-4a3d-a05b-0844454ddfc0 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:00.805473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f296426f-5e13-4a3d-a05b-0844454ddfc0 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:00.806073 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f296426f-5e13-4a3d-a05b-0844454ddfc0 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:00.806676 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f296426f-5e13-4a3d-a05b-0844454ddfc0 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:00.807383 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f296426f-5e13-4a3d-a05b-0844454ddfc0 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:00.807875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f296426f-5e13-4a3d-a05b-0844454ddfc0 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:00.808328 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f296426f-5e13-4a3d-a05b-0844454ddfc0 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:00.974117 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f296426f-5e13-4a3d-a05b-0844454ddfc0 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:00.982055 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f296426f-5e13-4a3d-a05b-0844454ddfc0 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379" status: 200 len: 1319 microversion: 2.1 time: 0.189587 Oct 17 04:39:00.982552 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 420/853] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:00 2022] GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:02.005685 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3375f3a2-5cba-405f-86ec-0736db503b09 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:02.006215 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3375f3a2-5cba-405f-86ec-0736db503b09 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:02.012619 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3375f3a2-5cba-405f-86ec-0736db503b09 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:02.013243 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3375f3a2-5cba-405f-86ec-0736db503b09 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:02.013960 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3375f3a2-5cba-405f-86ec-0736db503b09 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:02.015014 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3375f3a2-5cba-405f-86ec-0736db503b09 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:02.015718 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3375f3a2-5cba-405f-86ec-0736db503b09 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:02.016489 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3375f3a2-5cba-405f-86ec-0736db503b09 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:02.190749 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-3375f3a2-5cba-405f-86ec-0736db503b09 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:02.200462 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3375f3a2-5cba-405f-86ec-0736db503b09 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379" status: 200 len: 1319 microversion: 2.1 time: 0.199160 Oct 17 04:39:02.201455 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 434/854] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:02 2022] GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:03.223544 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5a52fa33-fc03-4615-a535-6e06e9d7a67f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:03.224240 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5a52fa33-fc03-4615-a535-6e06e9d7a67f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:03.230805 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a52fa33-fc03-4615-a535-6e06e9d7a67f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:03.231296 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a52fa33-fc03-4615-a535-6e06e9d7a67f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:03.231735 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a52fa33-fc03-4615-a535-6e06e9d7a67f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:03.232433 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a52fa33-fc03-4615-a535-6e06e9d7a67f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:03.232896 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a52fa33-fc03-4615-a535-6e06e9d7a67f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:03.233354 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5a52fa33-fc03-4615-a535-6e06e9d7a67f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:03.368598 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-5a52fa33-fc03-4615-a535-6e06e9d7a67f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:03.376930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5a52fa33-fc03-4615-a535-6e06e9d7a67f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379" status: 200 len: 1319 microversion: 2.1 time: 0.157432 Oct 17 04:39:03.377526 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 421/855] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:03 2022] GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:03.612534 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3eec0358-3a8a-4854-b153-547b9c34e134 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-596127097", "imageRef": "bf655d8c-fb2f-42ef-a7a7-0386f57b58cf", "flavorRef": "452"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:39:03.670407 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-3eec0358-3a8a-4854-b153-547b9c34e134 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] validate_networks() for None {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:39:03.958001 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3eec0358-3a8a-4854-b153-547b9c34e134 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:39:03.958574 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3eec0358-3a8a-4854-b153-547b9c34e134 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:39:03.959141 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3eec0358-3a8a-4854-b153-547b9c34e134 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:39:03.959738 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3eec0358-3a8a-4854-b153-547b9c34e134 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:39:03.960198 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-3eec0358-3a8a-4854-b153-547b9c34e134 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:39:03.969195 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eec0358-3a8a-4854-b153-547b9c34e134 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:03.969673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eec0358-3a8a-4854-b153-547b9c34e134 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:03.970106 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eec0358-3a8a-4854-b153-547b9c34e134 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:03.970827 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eec0358-3a8a-4854-b153-547b9c34e134 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:03.971302 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eec0358-3a8a-4854-b153-547b9c34e134 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:03.971721 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3eec0358-3a8a-4854-b153-547b9c34e134 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:03.988332 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-3eec0358-3a8a-4854-b153-547b9c34e134 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Getting quotas for project b47a647167004571b1d394c4bce1380e. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:39:03.992842 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-3eec0358-3a8a-4854-b153-547b9c34e134 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Getting quotas for user c6f010ccf70f43fca6385aba18293584 and project b47a647167004571b1d394c4bce1380e. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:39:04.004268 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3eec0358-3a8a-4854-b153-547b9c34e134 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:39:04.006939 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3eec0358-3a8a-4854-b153-547b9c34e134 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf655d8c-fb2f-42ef-a7a7-0386f57b58cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:39:04.054187 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3eec0358-3a8a-4854-b153-547b9c34e134 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.445415 Oct 17 04:39:04.055151 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 435/856] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:39:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 04:39:04.066357 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-340aab91-18a4-45f1-9c83-0c70f16216a2 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:04.068430 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-340aab91-18a4-45f1-9c83-0c70f16216a2 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:04.139119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-340aab91-18a4-45f1-9c83-0c70f16216a2 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:04.147081 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-340aab91-18a4-45f1-9c83-0c70f16216a2 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1214 microversion: 2.1 time: 0.084856 Oct 17 04:39:04.147853 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 422/857] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:04 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:04.403944 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5ed72745-2c9f-4192-8464-6750deb8066b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:04.405352 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5ed72745-2c9f-4192-8464-6750deb8066b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:04.414527 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ed72745-2c9f-4192-8464-6750deb8066b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:04.415296 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ed72745-2c9f-4192-8464-6750deb8066b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:04.415909 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ed72745-2c9f-4192-8464-6750deb8066b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:04.417298 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ed72745-2c9f-4192-8464-6750deb8066b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:04.417932 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ed72745-2c9f-4192-8464-6750deb8066b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:04.419040 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5ed72745-2c9f-4192-8464-6750deb8066b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:04.433108 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-418910ad-a874-4b57-b802-81f99bbc97c3 req-d13da50e-21f0-47ff-b37a-c940727f3a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ac795f-3972-41bd-b28f-8ddf3990a379", "name": "network-vif-plugged", "status": "completed", "tag": "4b85bbb5-c664-41f0-b1ec-715507c7f011"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:39:04.453641 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-418910ad-a874-4b57-b802-81f99bbc97c3 req-d13da50e-21f0-47ff-b37a-c940727f3a9c service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:04.454136 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-418910ad-a874-4b57-b802-81f99bbc97c3 req-d13da50e-21f0-47ff-b37a-c940727f3a9c service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:04.456124 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-418910ad-a874-4b57-b802-81f99bbc97c3 req-d13da50e-21f0-47ff-b37a-c940727f3a9c service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:04.483386 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-418910ad-a874-4b57-b802-81f99bbc97c3 req-d13da50e-21f0-47ff-b37a-c940727f3a9c service nova] Creating event network-vif-plugged:4b85bbb5-c664-41f0-b1ec-715507c7f011 for instance 32ac795f-3972-41bd-b28f-8ddf3990a379 on hv-cinder-86155 Oct 17 04:39:04.495037 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-418910ad-a874-4b57-b802-81f99bbc97c3 req-d13da50e-21f0-47ff-b37a-c940727f3a9c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065621 Oct 17 04:39:04.496307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 423/858] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:39:04.630173 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5ed72745-2c9f-4192-8464-6750deb8066b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:04.638592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5ed72745-2c9f-4192-8464-6750deb8066b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379" status: 200 len: 1319 microversion: 2.1 time: 0.239630 Oct 17 04:39:04.653646 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 436/859] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:04 2022] GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:05.170145 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3747aee7-511a-417e-bf4c-910406986d7f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:05.170830 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3747aee7-511a-417e-bf4c-910406986d7f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:05.177486 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3747aee7-511a-417e-bf4c-910406986d7f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:05.177966 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3747aee7-511a-417e-bf4c-910406986d7f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:05.178397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3747aee7-511a-417e-bf4c-910406986d7f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:05.179079 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3747aee7-511a-417e-bf4c-910406986d7f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:05.179521 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3747aee7-511a-417e-bf4c-910406986d7f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:05.179936 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3747aee7-511a-417e-bf4c-910406986d7f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:05.257794 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3747aee7-511a-417e-bf4c-910406986d7f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:05.266499 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3747aee7-511a-417e-bf4c-910406986d7f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1266 microversion: 2.1 time: 0.100465 Oct 17 04:39:05.267079 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 424/860] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:05 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:05.664076 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-25c874ed-e78b-475d-83bc-bce74987b33f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:05.664875 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-25c874ed-e78b-475d-83bc-bce74987b33f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:05.672177 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25c874ed-e78b-475d-83bc-bce74987b33f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:05.672757 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25c874ed-e78b-475d-83bc-bce74987b33f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:05.673329 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25c874ed-e78b-475d-83bc-bce74987b33f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:05.674387 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25c874ed-e78b-475d-83bc-bce74987b33f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:05.674907 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25c874ed-e78b-475d-83bc-bce74987b33f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:05.675416 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-25c874ed-e78b-475d-83bc-bce74987b33f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:05.865839 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-25c874ed-e78b-475d-83bc-bce74987b33f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:05.873498 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-25c874ed-e78b-475d-83bc-bce74987b33f tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379" status: 200 len: 1319 microversion: 2.1 time: 0.215274 Oct 17 04:39:05.874156 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 437/861] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:05 2022] GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:06.291527 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-13eff74f-75ea-44de-abbe-482038e4259f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:06.292227 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-13eff74f-75ea-44de-abbe-482038e4259f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:06.300212 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:39:06.308375 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13eff74f-75ea-44de-abbe-482038e4259f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:06.308906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13eff74f-75ea-44de-abbe-482038e4259f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:06.312995 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13eff74f-75ea-44de-abbe-482038e4259f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:06.314709 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13eff74f-75ea-44de-abbe-482038e4259f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:06.315183 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13eff74f-75ea-44de-abbe-482038e4259f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:06.315619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-13eff74f-75ea-44de-abbe-482038e4259f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:06.390996 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-13eff74f-75ea-44de-abbe-482038e4259f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:06.393550 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=45 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:39:06.401955 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-13eff74f-75ea-44de-abbe-482038e4259f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1272 microversion: 2.1 time: 0.116186 Oct 17 04:39:06.402607 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 425/862] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:06 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1272 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:39:06.896952 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-71507453-14b3-4ffb-a793-95a63e3a01d7 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:06.897688 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-71507453-14b3-4ffb-a793-95a63e3a01d7 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:06.905878 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71507453-14b3-4ffb-a793-95a63e3a01d7 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:06.906959 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71507453-14b3-4ffb-a793-95a63e3a01d7 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:06.907411 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71507453-14b3-4ffb-a793-95a63e3a01d7 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:06.908123 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71507453-14b3-4ffb-a793-95a63e3a01d7 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:06.908587 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71507453-14b3-4ffb-a793-95a63e3a01d7 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:06.909019 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-71507453-14b3-4ffb-a793-95a63e3a01d7 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:07.061117 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-71507453-14b3-4ffb-a793-95a63e3a01d7 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:07.072026 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-71507453-14b3-4ffb-a793-95a63e3a01d7 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379" status: 200 len: 1508 microversion: 2.1 time: 0.179993 Oct 17 04:39:07.072804 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 438/863] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:06 2022] GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379 => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:07.097948 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-968ae198-ee25-438c-adaa-f85695a17178 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f78d851e-67f9-4a39-8b44-7f881c24f4ff", "device": "/dev/sdb"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:39:07.103058 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-968ae198-ee25-438c-adaa-f85695a17178 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:07.105755 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:39:07.114044 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-968ae198-ee25-438c-adaa-f85695a17178 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:07.114830 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-968ae198-ee25-438c-adaa-f85695a17178 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:07.115178 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-968ae198-ee25-438c-adaa-f85695a17178 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:07.116129 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-968ae198-ee25-438c-adaa-f85695a17178 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:07.116711 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-968ae198-ee25-438c-adaa-f85695a17178 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:07.117268 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-968ae198-ee25-438c-adaa-f85695a17178 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:07.433780 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3a3024b4-b7b3-4247-aea1-29e641177198 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:07.434476 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3a3024b4-b7b3-4247-aea1-29e641177198 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:07.436504 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:39:07.449952 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a3024b4-b7b3-4247-aea1-29e641177198 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:07.450453 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a3024b4-b7b3-4247-aea1-29e641177198 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:07.450878 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a3024b4-b7b3-4247-aea1-29e641177198 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:07.451582 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a3024b4-b7b3-4247-aea1-29e641177198 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:07.452243 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a3024b4-b7b3-4247-aea1-29e641177198 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:07.453709 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3a3024b4-b7b3-4247-aea1-29e641177198 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:07.477403 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-968ae198-ee25-438c-adaa-f85695a17178 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "POST /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384522 Oct 17 04:39:07.478624 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 426/864] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Oct 17 04:39:07 2022] POST /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:39:07.662181 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a5cbbb2c-2aa1-4a54-9866-ba32ec501742 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1251308241", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-118990177", "security_groups": [{"name": "tempest-secgroup-smoke-1961840361"}], "block_device_mapping_v2": [{"uuid": "c7c24a4f-69f3-43bd-b82b-d703150d139d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7b10358-ab79-44d7-a22b-ddfa538fb104"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:39:07.730904 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-3a3024b4-b7b3-4247-aea1-29e641177198 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:07.739186 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3a3024b4-b7b3-4247-aea1-29e641177198 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1314 microversion: 2.1 time: 0.308724 Oct 17 04:39:07.739779 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 439/865] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:07 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:07.861838 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-a5cbbb2c-2aa1-4a54-9866-ba32ec501742 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] validate_networks() for [('e7b10358-ab79-44d7-a22b-ddfa538fb104', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:39:08.284542 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a5cbbb2c-2aa1-4a54-9866-ba32ec501742 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:39:08.285701 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a5cbbb2c-2aa1-4a54-9866-ba32ec501742 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:39:08.286405 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a5cbbb2c-2aa1-4a54-9866-ba32ec501742 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:39:08.286815 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a5cbbb2c-2aa1-4a54-9866-ba32ec501742 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:39:08.287489 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-a5cbbb2c-2aa1-4a54-9866-ba32ec501742 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:39:08.299216 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5cbbb2c-2aa1-4a54-9866-ba32ec501742 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:08.299704 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5cbbb2c-2aa1-4a54-9866-ba32ec501742 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:08.300171 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5cbbb2c-2aa1-4a54-9866-ba32ec501742 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:08.301110 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5cbbb2c-2aa1-4a54-9866-ba32ec501742 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:08.301655 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5cbbb2c-2aa1-4a54-9866-ba32ec501742 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:08.302093 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5cbbb2c-2aa1-4a54-9866-ba32ec501742 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:08.319584 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-a5cbbb2c-2aa1-4a54-9866-ba32ec501742 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Getting quotas for project 84d236da3b7b46f4ab13a096d7d80298. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:39:08.323637 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-a5cbbb2c-2aa1-4a54-9866-ba32ec501742 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Getting quotas for user 2ed9c2a1827b4fc5a916092b30bdec15 and project 84d236da3b7b46f4ab13a096d7d80298. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:39:08.380859 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-a25b7a85-9c5f-4695-b052-64f6c1d79250 req-bc957745-18c8-40d9-9b4c-905f126d8901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cf947c9-3543-4dc7-b4cb-77d8343ac72b", "tag": "31994807-d7f9-4b0e-a3b6-00fcf9c9d5ef"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:39:08.397510 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a25b7a85-9c5f-4695-b052-64f6c1d79250 req-bc957745-18c8-40d9-9b4c-905f126d8901 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:08.397891 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a5cbbb2c-2aa1-4a54-9866-ba32ec501742 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:39:08.398031 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a25b7a85-9c5f-4695-b052-64f6c1d79250 req-bc957745-18c8-40d9-9b4c-905f126d8901 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:08.398462 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-a25b7a85-9c5f-4695-b052-64f6c1d79250 req-bc957745-18c8-40d9-9b4c-905f126d8901 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:08.400297 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a5cbbb2c-2aa1-4a54-9866-ba32ec501742 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c7c24a4f-69f3-43bd-b82b-d703150d139d',volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:39:08.410712 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-a25b7a85-9c5f-4695-b052-64f6c1d79250 req-bc957745-18c8-40d9-9b4c-905f126d8901 service nova] Creating event network-changed:31994807-d7f9-4b0e-a3b6-00fcf9c9d5ef for instance 3cf947c9-3543-4dc7-b4cb-77d8343ac72b on hv-cinder-86155 Oct 17 04:39:08.416055 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-a25b7a85-9c5f-4695-b052-64f6c1d79250 req-bc957745-18c8-40d9-9b4c-905f126d8901 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039651 Oct 17 04:39:08.417196 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 440/866] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:39:08.561263 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a5cbbb2c-2aa1-4a54-9866-ba32ec501742 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.904762 Oct 17 04:39:08.569048 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 427/867] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:39:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 04:39:08.574959 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-fe4f7684-f01c-437d-a1b2-ae6a285f7150 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:08.575834 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-fe4f7684-f01c-437d-a1b2-ae6a285f7150 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:08.689821 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-fe4f7684-f01c-437d-a1b2-ae6a285f7150 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:08.700884 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-fe4f7684-f01c-437d-a1b2-ae6a285f7150 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1094 microversion: 2.1 time: 0.130206 Oct 17 04:39:08.702423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 441/868] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:08 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1094 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:39:08.763233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3fc102f0-b8b0-4add-9dc8-da05e5021dfc tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:08.763887 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3fc102f0-b8b0-4add-9dc8-da05e5021dfc tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:08.773008 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fc102f0-b8b0-4add-9dc8-da05e5021dfc tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:08.773714 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fc102f0-b8b0-4add-9dc8-da05e5021dfc tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:08.774146 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fc102f0-b8b0-4add-9dc8-da05e5021dfc tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:08.774847 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fc102f0-b8b0-4add-9dc8-da05e5021dfc tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:08.775295 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fc102f0-b8b0-4add-9dc8-da05e5021dfc tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:08.775714 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3fc102f0-b8b0-4add-9dc8-da05e5021dfc tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:08.944987 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3fc102f0-b8b0-4add-9dc8-da05e5021dfc tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:08.954289 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3fc102f0-b8b0-4add-9dc8-da05e5021dfc tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1314 microversion: 2.1 time: 0.194828 Oct 17 04:39:08.955655 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 428/869] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:08 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:09.728371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-1a15c6c9-37d8-4f72-9862-81d0ab88d5e4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:09.729588 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-1a15c6c9-37d8-4f72-9862-81d0ab88d5e4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:09.737175 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a15c6c9-37d8-4f72-9862-81d0ab88d5e4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:09.737664 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a15c6c9-37d8-4f72-9862-81d0ab88d5e4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:09.738230 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a15c6c9-37d8-4f72-9862-81d0ab88d5e4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:09.739042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a15c6c9-37d8-4f72-9862-81d0ab88d5e4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:09.739496 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a15c6c9-37d8-4f72-9862-81d0ab88d5e4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:09.739921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-1a15c6c9-37d8-4f72-9862-81d0ab88d5e4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:09.980344 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0dc3888b-80f8-4e50-9be0-ce67317af41f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:09.981405 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0dc3888b-80f8-4e50-9be0-ce67317af41f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:09.983164 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-1a15c6c9-37d8-4f72-9862-81d0ab88d5e4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:09.992701 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-1a15c6c9-37d8-4f72-9862-81d0ab88d5e4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1136 microversion: 2.1 time: 0.270637 Oct 17 04:39:09.997174 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dc3888b-80f8-4e50-9be0-ce67317af41f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:09.997777 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dc3888b-80f8-4e50-9be0-ce67317af41f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:09.998231 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dc3888b-80f8-4e50-9be0-ce67317af41f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:09.998987 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dc3888b-80f8-4e50-9be0-ce67317af41f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:09.999444 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dc3888b-80f8-4e50-9be0-ce67317af41f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:10.005154 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0dc3888b-80f8-4e50-9be0-ce67317af41f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:10.005382 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 442/870] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:09 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1136 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:10.164056 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-0dc3888b-80f8-4e50-9be0-ce67317af41f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:10.171999 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0dc3888b-80f8-4e50-9be0-ce67317af41f tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1314 microversion: 2.1 time: 0.196805 Oct 17 04:39:10.172772 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 429/871] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:09 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:39:11.024950 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cd2ccad0-2c24-4228-85c8-0f2cc27a860c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:11.025571 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cd2ccad0-2c24-4228-85c8-0f2cc27a860c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:11.031836 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd2ccad0-2c24-4228-85c8-0f2cc27a860c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:11.032318 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd2ccad0-2c24-4228-85c8-0f2cc27a860c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:11.032752 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd2ccad0-2c24-4228-85c8-0f2cc27a860c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:11.033467 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd2ccad0-2c24-4228-85c8-0f2cc27a860c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:11.033918 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd2ccad0-2c24-4228-85c8-0f2cc27a860c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:11.034390 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cd2ccad0-2c24-4228-85c8-0f2cc27a860c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:11.095793 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-cd2ccad0-2c24-4228-85c8-0f2cc27a860c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:11.103534 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cd2ccad0-2c24-4228-85c8-0f2cc27a860c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1210 microversion: 2.1 time: 0.082598 Oct 17 04:39:11.104097 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 443/872] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:11 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:11.197639 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e55403a5-362a-410c-8bf1-f058788352fe tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:11.198339 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e55403a5-362a-410c-8bf1-f058788352fe tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:11.205191 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e55403a5-362a-410c-8bf1-f058788352fe tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:11.205753 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e55403a5-362a-410c-8bf1-f058788352fe tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:11.206258 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e55403a5-362a-410c-8bf1-f058788352fe tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:11.207128 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e55403a5-362a-410c-8bf1-f058788352fe tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:11.208374 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e55403a5-362a-410c-8bf1-f058788352fe tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:11.208959 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e55403a5-362a-410c-8bf1-f058788352fe tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:11.368458 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e55403a5-362a-410c-8bf1-f058788352fe tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:11.379973 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e55403a5-362a-410c-8bf1-f058788352fe tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1314 microversion: 2.1 time: 0.186575 Oct 17 04:39:11.380873 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 430/873] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:11 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:12.127666 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-7ac6200f-5887-459f-acb0-e32a10b97f6a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:12.129171 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-7ac6200f-5887-459f-acb0-e32a10b97f6a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:12.136838 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ac6200f-5887-459f-acb0-e32a10b97f6a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:12.137434 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ac6200f-5887-459f-acb0-e32a10b97f6a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:12.138107 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ac6200f-5887-459f-acb0-e32a10b97f6a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:12.139075 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ac6200f-5887-459f-acb0-e32a10b97f6a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:12.139737 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ac6200f-5887-459f-acb0-e32a10b97f6a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:12.140582 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-7ac6200f-5887-459f-acb0-e32a10b97f6a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:12.239942 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-cb24e1bf-9a10-424c-967e-778d445e994c req-705e95c7-d13d-4d82-8db4-30244f1682b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed045a1c-3978-4818-8ea0-9ee3711acd79", "tag": "f723b755-7765-47ee-b1b3-a93d16d5f472"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:39:12.264017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-cb24e1bf-9a10-424c-967e-778d445e994c req-705e95c7-d13d-4d82-8db4-30244f1682b6 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:12.264534 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-cb24e1bf-9a10-424c-967e-778d445e994c req-705e95c7-d13d-4d82-8db4-30244f1682b6 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:12.265012 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-cb24e1bf-9a10-424c-967e-778d445e994c req-705e95c7-d13d-4d82-8db4-30244f1682b6 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:12.282028 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-cb24e1bf-9a10-424c-967e-778d445e994c req-705e95c7-d13d-4d82-8db4-30244f1682b6 service nova] Creating event network-changed:f723b755-7765-47ee-b1b3-a93d16d5f472 for instance ed045a1c-3978-4818-8ea0-9ee3711acd79 on hv-cinder-86155 Oct 17 04:39:12.286804 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-cb24e1bf-9a10-424c-967e-778d445e994c req-705e95c7-d13d-4d82-8db4-30244f1682b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050782 Oct 17 04:39:12.288349 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 431/874] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:39:12.304233 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-7ac6200f-5887-459f-acb0-e32a10b97f6a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:12.317567 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-7ac6200f-5887-459f-acb0-e32a10b97f6a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1278 microversion: 2.1 time: 0.193526 Oct 17 04:39:12.318336 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 444/875] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:12 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1278 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:12.404897 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b865f16d-7df4-462a-a325-3b68e385c340 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:12.405736 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b865f16d-7df4-462a-a325-3b68e385c340 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:12.413438 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b865f16d-7df4-462a-a325-3b68e385c340 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:12.413918 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b865f16d-7df4-462a-a325-3b68e385c340 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:12.414546 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b865f16d-7df4-462a-a325-3b68e385c340 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:12.415257 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b865f16d-7df4-462a-a325-3b68e385c340 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:12.415863 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b865f16d-7df4-462a-a325-3b68e385c340 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:12.416450 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b865f16d-7df4-462a-a325-3b68e385c340 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:12.557842 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-b865f16d-7df4-462a-a325-3b68e385c340 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:12.567024 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b865f16d-7df4-462a-a325-3b68e385c340 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1314 microversion: 2.1 time: 0.166780 Oct 17 04:39:12.568029 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 432/876] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:12 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:13.341280 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-df5c1f2e-7d1d-4d9d-8bc2-4cc12687c830 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:13.342495 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-df5c1f2e-7d1d-4d9d-8bc2-4cc12687c830 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:13.350953 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df5c1f2e-7d1d-4d9d-8bc2-4cc12687c830 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:13.351446 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df5c1f2e-7d1d-4d9d-8bc2-4cc12687c830 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:13.351882 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df5c1f2e-7d1d-4d9d-8bc2-4cc12687c830 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:13.352622 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df5c1f2e-7d1d-4d9d-8bc2-4cc12687c830 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:13.353105 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df5c1f2e-7d1d-4d9d-8bc2-4cc12687c830 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:13.353519 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-df5c1f2e-7d1d-4d9d-8bc2-4cc12687c830 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:13.488094 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-df5c1f2e-7d1d-4d9d-8bc2-4cc12687c830 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:13.495863 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-df5c1f2e-7d1d-4d9d-8bc2-4cc12687c830 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1278 microversion: 2.1 time: 0.158553 Oct 17 04:39:13.496427 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 445/877] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:13 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:13.591543 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a8baf73c-3d9a-46b7-ac5a-88e1c44b4449 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:13.592167 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a8baf73c-3d9a-46b7-ac5a-88e1c44b4449 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:13.598539 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8baf73c-3d9a-46b7-ac5a-88e1c44b4449 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:13.599015 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8baf73c-3d9a-46b7-ac5a-88e1c44b4449 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:13.599450 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8baf73c-3d9a-46b7-ac5a-88e1c44b4449 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:13.600157 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8baf73c-3d9a-46b7-ac5a-88e1c44b4449 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:13.600606 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8baf73c-3d9a-46b7-ac5a-88e1c44b4449 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:13.601027 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8baf73c-3d9a-46b7-ac5a-88e1c44b4449 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:13.744239 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-a8baf73c-3d9a-46b7-ac5a-88e1c44b4449 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:13.752319 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a8baf73c-3d9a-46b7-ac5a-88e1c44b4449 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1314 microversion: 2.1 time: 0.164552 Oct 17 04:39:13.752885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 433/878] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:13 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:14.498587 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:39:14.503467 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-fe7b8cd6-c1ce-404d-ae47-f110019ce7a3 req-e324ce80-d2e1-4ebc-9838-a5f83c2b3eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf947c9-3543-4dc7-b4cb-77d8343ac72b", "name": "network-vif-plugged", "status": "completed", "tag": "31994807-d7f9-4b0e-a3b6-00fcf9c9d5ef"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:39:14.520093 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fe7b8cd6-c1ce-404d-ae47-f110019ce7a3 req-e324ce80-d2e1-4ebc-9838-a5f83c2b3eb7 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:14.520811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fe7b8cd6-c1ce-404d-ae47-f110019ce7a3 req-e324ce80-d2e1-4ebc-9838-a5f83c2b3eb7 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:14.521730 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-fe7b8cd6-c1ce-404d-ae47-f110019ce7a3 req-e324ce80-d2e1-4ebc-9838-a5f83c2b3eb7 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:14.522208 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ad9aeee0-f29b-4293-9d5e-5376b97ed315 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:14.523060 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ad9aeee0-f29b-4293-9d5e-5376b97ed315 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:14.530893 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad9aeee0-f29b-4293-9d5e-5376b97ed315 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:14.531836 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad9aeee0-f29b-4293-9d5e-5376b97ed315 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:14.532619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad9aeee0-f29b-4293-9d5e-5376b97ed315 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:14.533671 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad9aeee0-f29b-4293-9d5e-5376b97ed315 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:14.534387 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad9aeee0-f29b-4293-9d5e-5376b97ed315 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:14.535124 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ad9aeee0-f29b-4293-9d5e-5376b97ed315 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:14.536921 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-fe7b8cd6-c1ce-404d-ae47-f110019ce7a3 req-e324ce80-d2e1-4ebc-9838-a5f83c2b3eb7 service nova] Creating event network-vif-plugged:31994807-d7f9-4b0e-a3b6-00fcf9c9d5ef for instance 3cf947c9-3543-4dc7-b4cb-77d8343ac72b on hv-cinder-86155 Oct 17 04:39:14.543908 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-fe7b8cd6-c1ce-404d-ae47-f110019ce7a3 req-e324ce80-d2e1-4ebc-9838-a5f83c2b3eb7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045501 Oct 17 04:39:14.544884 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 446/879] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:39:14.693651 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-ad9aeee0-f29b-4293-9d5e-5376b97ed315 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:14.701900 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ad9aeee0-f29b-4293-9d5e-5376b97ed315 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1266 microversion: 2.1 time: 0.186181 Oct 17 04:39:14.702832 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 434/880] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:14 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:39:14.777117 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c6441fd5-f999-495e-93e7-34bd09ebf810 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:14.777737 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c6441fd5-f999-495e-93e7-34bd09ebf810 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:14.783826 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6441fd5-f999-495e-93e7-34bd09ebf810 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:14.784307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6441fd5-f999-495e-93e7-34bd09ebf810 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:14.784740 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6441fd5-f999-495e-93e7-34bd09ebf810 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:14.785595 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6441fd5-f999-495e-93e7-34bd09ebf810 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:14.786050 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6441fd5-f999-495e-93e7-34bd09ebf810 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:14.786478 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c6441fd5-f999-495e-93e7-34bd09ebf810 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:14.917828 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c6441fd5-f999-495e-93e7-34bd09ebf810 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:14.931914 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c6441fd5-f999-495e-93e7-34bd09ebf810 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1314 microversion: 2.1 time: 0.158990 Oct 17 04:39:14.932770 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 447/881] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:14 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:15.726004 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-517900da-6ad7-4776-a4d1-5d6aef1fc96c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:15.726617 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-517900da-6ad7-4776-a4d1-5d6aef1fc96c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:15.732998 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-517900da-6ad7-4776-a4d1-5d6aef1fc96c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:15.733532 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-517900da-6ad7-4776-a4d1-5d6aef1fc96c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:15.733969 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-517900da-6ad7-4776-a4d1-5d6aef1fc96c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:15.734657 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-517900da-6ad7-4776-a4d1-5d6aef1fc96c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:15.735144 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-517900da-6ad7-4776-a4d1-5d6aef1fc96c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:15.735566 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-517900da-6ad7-4776-a4d1-5d6aef1fc96c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:15.868553 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-517900da-6ad7-4776-a4d1-5d6aef1fc96c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:15.876155 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-517900da-6ad7-4776-a4d1-5d6aef1fc96c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1266 microversion: 2.1 time: 0.154096 Oct 17 04:39:15.876718 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 435/882] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:15 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:15.955123 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-6f5498b8-1958-497d-a658-f8d92511b7d8 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:15.955733 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-6f5498b8-1958-497d-a658-f8d92511b7d8 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:15.962408 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f5498b8-1958-497d-a658-f8d92511b7d8 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:15.962887 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f5498b8-1958-497d-a658-f8d92511b7d8 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:15.963318 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f5498b8-1958-497d-a658-f8d92511b7d8 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:15.964007 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f5498b8-1958-497d-a658-f8d92511b7d8 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:15.964568 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f5498b8-1958-497d-a658-f8d92511b7d8 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:15.965004 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-6f5498b8-1958-497d-a658-f8d92511b7d8 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:16.090844 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-6f5498b8-1958-497d-a658-f8d92511b7d8 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:16.098851 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-6f5498b8-1958-497d-a658-f8d92511b7d8 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1314 microversion: 2.1 time: 0.147716 Oct 17 04:39:16.099567 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 448/883] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:15 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:16.900702 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-d3945c90-cbdb-4e54-ade3-76180e56ea8e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:16.901370 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-d3945c90-cbdb-4e54-ade3-76180e56ea8e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:16.907791 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3945c90-cbdb-4e54-ade3-76180e56ea8e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:16.908275 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3945c90-cbdb-4e54-ade3-76180e56ea8e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:16.908712 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3945c90-cbdb-4e54-ade3-76180e56ea8e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:16.909430 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3945c90-cbdb-4e54-ade3-76180e56ea8e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:16.909883 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3945c90-cbdb-4e54-ade3-76180e56ea8e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:16.911132 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-d3945c90-cbdb-4e54-ade3-76180e56ea8e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:17.040301 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-d3945c90-cbdb-4e54-ade3-76180e56ea8e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:17.048251 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-d3945c90-cbdb-4e54-ade3-76180e56ea8e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1266 microversion: 2.1 time: 0.151474 Oct 17 04:39:17.048836 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 436/884] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:16 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:17.122564 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-78104ce4-794e-4427-9b38-3fbb70afee97 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:17.123277 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-78104ce4-794e-4427-9b38-3fbb70afee97 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:17.130474 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78104ce4-794e-4427-9b38-3fbb70afee97 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:17.130941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78104ce4-794e-4427-9b38-3fbb70afee97 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:17.131396 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78104ce4-794e-4427-9b38-3fbb70afee97 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:17.132096 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78104ce4-794e-4427-9b38-3fbb70afee97 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:17.132551 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78104ce4-794e-4427-9b38-3fbb70afee97 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:17.132975 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-78104ce4-794e-4427-9b38-3fbb70afee97 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:17.267673 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-78104ce4-794e-4427-9b38-3fbb70afee97 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:17.276457 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-78104ce4-794e-4427-9b38-3fbb70afee97 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1314 microversion: 2.1 time: 0.157886 Oct 17 04:39:17.277017 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 449/885] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:17 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:18.070988 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-899ef6e2-3040-4174-952a-6c5113a0d102 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:18.071661 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-899ef6e2-3040-4174-952a-6c5113a0d102 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:18.077517 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-899ef6e2-3040-4174-952a-6c5113a0d102 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:18.078316 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-899ef6e2-3040-4174-952a-6c5113a0d102 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:18.078814 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-899ef6e2-3040-4174-952a-6c5113a0d102 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:18.079686 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-899ef6e2-3040-4174-952a-6c5113a0d102 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:18.080135 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-899ef6e2-3040-4174-952a-6c5113a0d102 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:18.080560 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-899ef6e2-3040-4174-952a-6c5113a0d102 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:18.212566 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-899ef6e2-3040-4174-952a-6c5113a0d102 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:18.226404 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-899ef6e2-3040-4174-952a-6c5113a0d102 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1266 microversion: 2.1 time: 0.159788 Oct 17 04:39:18.227002 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 437/886] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:18 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:18.298776 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-99fd74c3-434b-4c16-b1a5-d8500ebe97b4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:18.299512 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-99fd74c3-434b-4c16-b1a5-d8500ebe97b4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:18.306358 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99fd74c3-434b-4c16-b1a5-d8500ebe97b4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:18.306957 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99fd74c3-434b-4c16-b1a5-d8500ebe97b4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:18.307412 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99fd74c3-434b-4c16-b1a5-d8500ebe97b4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:18.308248 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99fd74c3-434b-4c16-b1a5-d8500ebe97b4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:18.308780 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99fd74c3-434b-4c16-b1a5-d8500ebe97b4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:18.309360 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-99fd74c3-434b-4c16-b1a5-d8500ebe97b4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:18.458232 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-99fd74c3-434b-4c16-b1a5-d8500ebe97b4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:18.466755 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-99fd74c3-434b-4c16-b1a5-d8500ebe97b4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1314 microversion: 2.1 time: 0.171827 Oct 17 04:39:18.467261 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 450/887] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:18 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:19.249188 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-064bed79-1037-4279-89a8-721f823fb45a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:19.249803 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-064bed79-1037-4279-89a8-721f823fb45a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:19.251710 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:39:19.252351 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=14 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:39:19.259212 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-064bed79-1037-4279-89a8-721f823fb45a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:19.259694 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-064bed79-1037-4279-89a8-721f823fb45a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:19.260130 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-064bed79-1037-4279-89a8-721f823fb45a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:19.260817 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-064bed79-1037-4279-89a8-721f823fb45a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:19.261300 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-064bed79-1037-4279-89a8-721f823fb45a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:19.261727 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-064bed79-1037-4279-89a8-721f823fb45a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:19.388598 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-064bed79-1037-4279-89a8-721f823fb45a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:19.396769 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-064bed79-1037-4279-89a8-721f823fb45a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1266 microversion: 2.1 time: 0.151456 Oct 17 04:39:19.397368 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 438/888] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:19 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:39:19.489585 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-19946bcf-0c41-4843-8305-e396700af9d9 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:19.490214 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-19946bcf-0c41-4843-8305-e396700af9d9 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:19.492131 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=14 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:39:19.498331 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19946bcf-0c41-4843-8305-e396700af9d9 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:19.498819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19946bcf-0c41-4843-8305-e396700af9d9 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:19.499253 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19946bcf-0c41-4843-8305-e396700af9d9 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:19.499946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19946bcf-0c41-4843-8305-e396700af9d9 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:19.500397 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19946bcf-0c41-4843-8305-e396700af9d9 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:19.500820 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-19946bcf-0c41-4843-8305-e396700af9d9 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:19.518982 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=100 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:39:19.631397 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-19946bcf-0c41-4843-8305-e396700af9d9 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:19.638998 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-19946bcf-0c41-4843-8305-e396700af9d9 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1314 microversion: 2.1 time: 0.153516 Oct 17 04:39:19.639567 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 451/889] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:19 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:20.419553 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ed6ab7d0-c8ec-4219-842f-c44dad290b7e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:20.420166 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ed6ab7d0-c8ec-4219-842f-c44dad290b7e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:20.426959 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed6ab7d0-c8ec-4219-842f-c44dad290b7e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:20.427446 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed6ab7d0-c8ec-4219-842f-c44dad290b7e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:20.427883 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed6ab7d0-c8ec-4219-842f-c44dad290b7e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:20.428573 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed6ab7d0-c8ec-4219-842f-c44dad290b7e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:20.429027 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed6ab7d0-c8ec-4219-842f-c44dad290b7e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:20.429477 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ed6ab7d0-c8ec-4219-842f-c44dad290b7e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:20.563414 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-ed6ab7d0-c8ec-4219-842f-c44dad290b7e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:20.571503 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ed6ab7d0-c8ec-4219-842f-c44dad290b7e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1266 microversion: 2.1 time: 0.155810 Oct 17 04:39:20.572073 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 439/890] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:20 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:20.662224 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-799d3591-6e9d-4379-9f01-25e8e65073cd tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:20.662829 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-799d3591-6e9d-4379-9f01-25e8e65073cd tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:20.668798 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-799d3591-6e9d-4379-9f01-25e8e65073cd tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:20.669326 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-799d3591-6e9d-4379-9f01-25e8e65073cd tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:20.669756 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-799d3591-6e9d-4379-9f01-25e8e65073cd tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:20.670440 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-799d3591-6e9d-4379-9f01-25e8e65073cd tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:20.670888 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-799d3591-6e9d-4379-9f01-25e8e65073cd tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:20.671306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-799d3591-6e9d-4379-9f01-25e8e65073cd tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:20.796341 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-799d3591-6e9d-4379-9f01-25e8e65073cd tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:20.804399 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-799d3591-6e9d-4379-9f01-25e8e65073cd tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1314 microversion: 2.1 time: 0.146890 Oct 17 04:39:20.804959 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 452/891] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:20 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:21.595270 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b238fadd-e67a-4bcf-bfa9-2d7753bdfb48 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:21.595889 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b238fadd-e67a-4bcf-bfa9-2d7753bdfb48 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:21.602377 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b238fadd-e67a-4bcf-bfa9-2d7753bdfb48 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:21.602864 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b238fadd-e67a-4bcf-bfa9-2d7753bdfb48 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:21.603297 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b238fadd-e67a-4bcf-bfa9-2d7753bdfb48 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:21.603984 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b238fadd-e67a-4bcf-bfa9-2d7753bdfb48 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:21.604434 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b238fadd-e67a-4bcf-bfa9-2d7753bdfb48 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:21.604856 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b238fadd-e67a-4bcf-bfa9-2d7753bdfb48 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:21.739380 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-b238fadd-e67a-4bcf-bfa9-2d7753bdfb48 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:21.747098 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b238fadd-e67a-4bcf-bfa9-2d7753bdfb48 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1266 microversion: 2.1 time: 0.155685 Oct 17 04:39:21.747669 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 440/892] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:21 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:21.827053 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a7db5453-7eeb-4819-b726-029e8917bd6c tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:21.827910 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a7db5453-7eeb-4819-b726-029e8917bd6c tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:21.834767 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7db5453-7eeb-4819-b726-029e8917bd6c tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:21.835242 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7db5453-7eeb-4819-b726-029e8917bd6c tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:21.835671 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7db5453-7eeb-4819-b726-029e8917bd6c tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:21.836350 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7db5453-7eeb-4819-b726-029e8917bd6c tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:21.836894 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7db5453-7eeb-4819-b726-029e8917bd6c tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:21.837348 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a7db5453-7eeb-4819-b726-029e8917bd6c tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:21.965543 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a7db5453-7eeb-4819-b726-029e8917bd6c tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:21.973780 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a7db5453-7eeb-4819-b726-029e8917bd6c tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1314 microversion: 2.1 time: 0.150580 Oct 17 04:39:21.974348 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 453/893] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:21 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:22.770580 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-c2954c75-16f0-449f-9b6c-a4cea18d41cf tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:22.771191 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-c2954c75-16f0-449f-9b6c-a4cea18d41cf tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:22.777876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2954c75-16f0-449f-9b6c-a4cea18d41cf tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:22.778380 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2954c75-16f0-449f-9b6c-a4cea18d41cf tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:22.778944 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2954c75-16f0-449f-9b6c-a4cea18d41cf tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:22.779634 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2954c75-16f0-449f-9b6c-a4cea18d41cf tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:22.780090 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2954c75-16f0-449f-9b6c-a4cea18d41cf tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:22.780513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-c2954c75-16f0-449f-9b6c-a4cea18d41cf tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:22.914855 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-c2954c75-16f0-449f-9b6c-a4cea18d41cf tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:22.922823 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-c2954c75-16f0-449f-9b6c-a4cea18d41cf tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1266 microversion: 2.1 time: 0.156435 Oct 17 04:39:22.923326 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 441/894] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:22 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:22.997522 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-662bc0dc-b1f0-46c5-9eb4-3fab4b0230d4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:22.998184 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-662bc0dc-b1f0-46c5-9eb4-3fab4b0230d4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:23.005334 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-662bc0dc-b1f0-46c5-9eb4-3fab4b0230d4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:23.005816 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-662bc0dc-b1f0-46c5-9eb4-3fab4b0230d4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:23.006250 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-662bc0dc-b1f0-46c5-9eb4-3fab4b0230d4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:23.006929 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-662bc0dc-b1f0-46c5-9eb4-3fab4b0230d4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:23.007378 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-662bc0dc-b1f0-46c5-9eb4-3fab4b0230d4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:23.007799 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-662bc0dc-b1f0-46c5-9eb4-3fab4b0230d4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:23.132534 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-662bc0dc-b1f0-46c5-9eb4-3fab4b0230d4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:23.140299 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-662bc0dc-b1f0-46c5-9eb4-3fab4b0230d4 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1463 microversion: 2.1 time: 0.147033 Oct 17 04:39:23.140926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 454/895] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:22 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1463 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:23.187554 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-995f7479-0d07-4a9b-85eb-f580a3043341 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:23.188060 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-995f7479-0d07-4a9b-85eb-f580a3043341 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:23.194273 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-995f7479-0d07-4a9b-85eb-f580a3043341 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:23.194755 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-995f7479-0d07-4a9b-85eb-f580a3043341 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:23.195190 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-995f7479-0d07-4a9b-85eb-f580a3043341 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:23.195880 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-995f7479-0d07-4a9b-85eb-f580a3043341 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:23.196324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-995f7479-0d07-4a9b-85eb-f580a3043341 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:23.196746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-995f7479-0d07-4a9b-85eb-f580a3043341 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:23.211665 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:39:23.223875 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-995f7479-0d07-4a9b-85eb-f580a3043341 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:39:23.298466 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-995f7479-0d07-4a9b-85eb-f580a3043341 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 204 len: 0 microversion: 2.1 time: 0.114360 Oct 17 04:39:23.299046 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 442/896] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:39:23 2022] DELETE /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:39:23.307468 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d44254c2-44c2-4f2c-9f09-704ba92ea9a5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:23.308077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d44254c2-44c2-4f2c-9f09-704ba92ea9a5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:23.313830 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d44254c2-44c2-4f2c-9f09-704ba92ea9a5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:23.314308 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d44254c2-44c2-4f2c-9f09-704ba92ea9a5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:23.314739 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d44254c2-44c2-4f2c-9f09-704ba92ea9a5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:23.315418 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d44254c2-44c2-4f2c-9f09-704ba92ea9a5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:23.315866 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d44254c2-44c2-4f2c-9f09-704ba92ea9a5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:23.316841 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d44254c2-44c2-4f2c-9f09-704ba92ea9a5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:23.443468 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-d44254c2-44c2-4f2c-9f09-704ba92ea9a5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:23.451141 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d44254c2-44c2-4f2c-9f09-704ba92ea9a5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1469 microversion: 2.1 time: 0.147509 Oct 17 04:39:23.451711 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 455/897] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:23 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1469 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:23.947067 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7430db72-a308-4050-8827-1b352be5f555 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:23.947796 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7430db72-a308-4050-8827-1b352be5f555 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:23.954496 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7430db72-a308-4050-8827-1b352be5f555 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:23.954984 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7430db72-a308-4050-8827-1b352be5f555 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:23.955455 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7430db72-a308-4050-8827-1b352be5f555 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:23.956170 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7430db72-a308-4050-8827-1b352be5f555 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:23.956631 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7430db72-a308-4050-8827-1b352be5f555 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:23.957987 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7430db72-a308-4050-8827-1b352be5f555 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:24.095682 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-7430db72-a308-4050-8827-1b352be5f555 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:24.103383 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7430db72-a308-4050-8827-1b352be5f555 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1266 microversion: 2.1 time: 0.160525 Oct 17 04:39:24.103957 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 443/898] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:23 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:24.475052 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-11d292cb-0ff5-48bb-ada1-2038d88e37e5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:24.475674 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-11d292cb-0ff5-48bb-ada1-2038d88e37e5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:24.482036 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11d292cb-0ff5-48bb-ada1-2038d88e37e5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:24.482525 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11d292cb-0ff5-48bb-ada1-2038d88e37e5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:24.482967 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11d292cb-0ff5-48bb-ada1-2038d88e37e5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:24.483661 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11d292cb-0ff5-48bb-ada1-2038d88e37e5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:24.484120 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11d292cb-0ff5-48bb-ada1-2038d88e37e5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:24.484547 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-11d292cb-0ff5-48bb-ada1-2038d88e37e5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:24.619846 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-11d292cb-0ff5-48bb-ada1-2038d88e37e5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:24.628118 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-11d292cb-0ff5-48bb-ada1-2038d88e37e5 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1469 microversion: 2.1 time: 0.156746 Oct 17 04:39:24.628626 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 456/899] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:24 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:25.126280 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ffe48a0b-ba72-4c51-b4f1-c0c1ce169858 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:25.126900 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ffe48a0b-ba72-4c51-b4f1-c0c1ce169858 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:25.133890 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ffe48a0b-ba72-4c51-b4f1-c0c1ce169858 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:25.134304 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ffe48a0b-ba72-4c51-b4f1-c0c1ce169858 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:25.134735 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ffe48a0b-ba72-4c51-b4f1-c0c1ce169858 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:25.135512 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ffe48a0b-ba72-4c51-b4f1-c0c1ce169858 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:25.135960 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ffe48a0b-ba72-4c51-b4f1-c0c1ce169858 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:25.137190 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ffe48a0b-ba72-4c51-b4f1-c0c1ce169858 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:25.271646 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-ffe48a0b-ba72-4c51-b4f1-c0c1ce169858 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:25.279635 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ffe48a0b-ba72-4c51-b4f1-c0c1ce169858 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1266 microversion: 2.1 time: 0.157480 Oct 17 04:39:25.280203 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 444/900] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:25 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:25.651727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-158a108a-6bb2-4b69-bfe9-0fd3fb28cc37 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:25.652466 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-158a108a-6bb2-4b69-bfe9-0fd3fb28cc37 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:25.658798 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-158a108a-6bb2-4b69-bfe9-0fd3fb28cc37 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:25.659287 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-158a108a-6bb2-4b69-bfe9-0fd3fb28cc37 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:25.659721 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-158a108a-6bb2-4b69-bfe9-0fd3fb28cc37 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:25.660583 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-158a108a-6bb2-4b69-bfe9-0fd3fb28cc37 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:25.661336 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-158a108a-6bb2-4b69-bfe9-0fd3fb28cc37 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:25.661794 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-158a108a-6bb2-4b69-bfe9-0fd3fb28cc37 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:25.727012 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-158a108a-6bb2-4b69-bfe9-0fd3fb28cc37 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6f010ccf70f43fca6385aba18293584', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47a647167004571b1d394c4bce1380e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:25.736407 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-158a108a-6bb2-4b69-bfe9-0fd3fb28cc37 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 200 len: 1427 microversion: 2.1 time: 0.088567 Oct 17 04:39:25.737340 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 457/901] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:25 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:25.784895 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-652fb040-fef7-4b52-82d9-acc211604f55 req-418383b7-d3c8-4d98-b497-3920827468c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf947c9-3543-4dc7-b4cb-77d8343ac72b", "name": "network-vif-deleted", "tag": "31994807-d7f9-4b0e-a3b6-00fcf9c9d5ef"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:39:25.796353 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-652fb040-fef7-4b52-82d9-acc211604f55 req-418383b7-d3c8-4d98-b497-3920827468c1 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:25.796836 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-652fb040-fef7-4b52-82d9-acc211604f55 req-418383b7-d3c8-4d98-b497-3920827468c1 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:25.797310 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-652fb040-fef7-4b52-82d9-acc211604f55 req-418383b7-d3c8-4d98-b497-3920827468c1 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:25.810981 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-652fb040-fef7-4b52-82d9-acc211604f55 req-418383b7-d3c8-4d98-b497-3920827468c1 service nova] Creating event network-vif-deleted:31994807-d7f9-4b0e-a3b6-00fcf9c9d5ef for instance 3cf947c9-3543-4dc7-b4cb-77d8343ac72b on hv-cinder-86155 Oct 17 04:39:25.817806 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-652fb040-fef7-4b52-82d9-acc211604f55 req-418383b7-d3c8-4d98-b497-3920827468c1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036361 Oct 17 04:39:25.818431 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 445/902] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:39:25.987126 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5368a212-fb87-4375-b530-9fd28b2c9f61 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:25.987726 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5368a212-fb87-4375-b530-9fd28b2c9f61 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:25.995346 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5368a212-fb87-4375-b530-9fd28b2c9f61 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:25.995808 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5368a212-fb87-4375-b530-9fd28b2c9f61 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:25.996237 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5368a212-fb87-4375-b530-9fd28b2c9f61 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:25.996922 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5368a212-fb87-4375-b530-9fd28b2c9f61 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:25.997399 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5368a212-fb87-4375-b530-9fd28b2c9f61 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:25.997821 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5368a212-fb87-4375-b530-9fd28b2c9f61 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:26.078046 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.objects.instance [None req-5368a212-fb87-4375-b530-9fd28b2c9f61 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lazy-loading 'services' on Instance uuid 32ac795f-3972-41bd-b28f-8ddf3990a379 {{(pid=119127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:39:26.149961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5368a212-fb87-4375-b530-9fd28b2c9f61 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "DELETE /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379/os-volume_attachments/f78d851e-67f9-4a39-8b44-7f881c24f4ff" status: 202 len: 0 microversion: 2.1 time: 0.166506 Oct 17 04:39:26.150545 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 458/903] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Oct 17 04:39:25 2022] DELETE /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379/os-volume_attachments/f78d851e-67f9-4a39-8b44-7f881c24f4ff => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:39:26.303124 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-581ff4e2-7ae5-488c-891a-5ed57c57afac tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:26.304069 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-581ff4e2-7ae5-488c-891a-5ed57c57afac tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:26.310909 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-581ff4e2-7ae5-488c-891a-5ed57c57afac tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:26.311398 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-581ff4e2-7ae5-488c-891a-5ed57c57afac tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:26.311837 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-581ff4e2-7ae5-488c-891a-5ed57c57afac tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:26.312535 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-581ff4e2-7ae5-488c-891a-5ed57c57afac tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:26.312988 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-581ff4e2-7ae5-488c-891a-5ed57c57afac tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:26.313445 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-581ff4e2-7ae5-488c-891a-5ed57c57afac tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:26.452874 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-581ff4e2-7ae5-488c-891a-5ed57c57afac tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:26.461332 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-581ff4e2-7ae5-488c-891a-5ed57c57afac tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1266 microversion: 2.1 time: 0.162501 Oct 17 04:39:26.461903 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 446/904] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:26 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:26.566641 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-77d14356-e846-46e4-be05-e7274339a94b req-c0d00514-24b4-46c3-a96b-43c62b4f4ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed045a1c-3978-4818-8ea0-9ee3711acd79", "name": "network-vif-plugged", "status": "completed", "tag": "f723b755-7765-47ee-b1b3-a93d16d5f472"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:39:26.573052 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-77d14356-e846-46e4-be05-e7274339a94b req-c0d00514-24b4-46c3-a96b-43c62b4f4ac7 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:26.573562 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-77d14356-e846-46e4-be05-e7274339a94b req-c0d00514-24b4-46c3-a96b-43c62b4f4ac7 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:26.573984 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-77d14356-e846-46e4-be05-e7274339a94b req-c0d00514-24b4-46c3-a96b-43c62b4f4ac7 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:26.585773 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-77d14356-e846-46e4-be05-e7274339a94b req-c0d00514-24b4-46c3-a96b-43c62b4f4ac7 service nova] Creating event network-vif-plugged:f723b755-7765-47ee-b1b3-a93d16d5f472 for instance ed045a1c-3978-4818-8ea0-9ee3711acd79 on hv-cinder-86155 Oct 17 04:39:26.591028 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-77d14356-e846-46e4-be05-e7274339a94b req-c0d00514-24b4-46c3-a96b-43c62b4f4ac7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032802 Oct 17 04:39:26.591767 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 459/905] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:39:26.763703 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8ef53c43-144e-466e-9143-c16f6a9343e7 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:26.764230 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8ef53c43-144e-466e-9143-c16f6a9343e7 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] [instance: 3cf947c9-3543-4dc7-b4cb-77d8343ac72b] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:26.770861 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ef53c43-144e-466e-9143-c16f6a9343e7 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:26.771344 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ef53c43-144e-466e-9143-c16f6a9343e7 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:26.771787 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ef53c43-144e-466e-9143-c16f6a9343e7 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:26.772468 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ef53c43-144e-466e-9143-c16f6a9343e7 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:26.772915 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ef53c43-144e-466e-9143-c16f6a9343e7 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:26.773506 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8ef53c43-144e-466e-9143-c16f6a9343e7 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:26.788411 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-8ef53c43-144e-466e-9143-c16f6a9343e7 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] HTTP exception thrown: Instance 3cf947c9-3543-4dc7-b4cb-77d8343ac72b could not be found. Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8ef53c43-144e-466e-9143-c16f6a9343e7 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Request method failure captured: Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b HTTP/1.1 Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNxlQcrCWyHxQmWJKfag9d200TbODjPm3-jMLUX_q1kGRd77bzAcDvXZotXis5k7cmuDo3awjds3XzbdulDcpB2WdqB0pzMnfOQWmj7B8x7XgWsopu22DQFiU64Dbc675yMgfZimDKeSKZIlg6JImQHmU1xFJ_iVK-6E6fza0F7gZgk Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: b47a647167004571b1d394c4bce1380e Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-VolumesNegativeTest-880976471 Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:39:26.790194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:39:26.792017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b47a647167004571b1d394c4bce1380e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b47a647167004571b1d394c4bce1380e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b47a647167004571b1d394c4bce1380e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b47a647167004571b1d394c4bce1380e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:39:26.792017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-VolumesNegativeTest-880976471 Oct 17 04:39:26.792017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: b47a647167004571b1d394c4bce1380e Oct 17 04:39:26.792017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-VolumesNegativeTest-880976471 Oct 17 04:39:26.792017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-VolumesNegativeTest-880976471-project Oct 17 04:39:26.792017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:39:26.792017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:39:26.792017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: c6f010ccf70f43fca6385aba18293584 Oct 17 04:39:26.792017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-VolumesNegativeTest-880976471-project Oct 17 04:39:26.792017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:39:26.792017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance 3cf947c9-3543-4dc7-b4cb-77d8343ac72b could not be found. Oct 17 04:39:26.792017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': '3cf947c9-3543-4dc7-b4cb-77d8343ac72b'} Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cf947c9-3543-4dc7-b4cb-77d8343ac72b could not be found. Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:39:26.793168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:39:26.794826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:39:26.794826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:39:26.794826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:39:26.794826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:39:26.794826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:39:26.794826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:39:26.794826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:39:26.794826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cf947c9-3543-4dc7-b4cb-77d8343ac72b could not be found. Oct 17 04:39:26.794826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:39:26.794826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:39:26.794826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:39:26.794826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:39:26.794826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:39:26.794826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:39:26.794826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:39:26.794826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:39:26.794826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cf947c9-3543-4dc7-b4cb-77d8343ac72b could not be found. Oct 17 04:39:26.794826 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:39:26.796311 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8ef53c43-144e-466e-9143-c16f6a9343e7 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] Returning 404 to user: Instance 3cf947c9-3543-4dc7-b4cb-77d8343ac72b could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:39:26.796311 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8ef53c43-144e-466e-9143-c16f6a9343e7 tempest-VolumesNegativeTest-880976471 tempest-VolumesNegativeTest-880976471-project] 10.222.0.40 "GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b" status: 404 len: 111 microversion: 2.1 time: 0.033138 Oct 17 04:39:26.796311 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 447/906] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:26 2022] GET /compute/v2.1/servers/3cf947c9-3543-4dc7-b4cb-77d8343ac72b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:39:27.274298 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-28d10313-bf81-42e0-b535-5531cdf5df0d tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:27.274983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-28d10313-bf81-42e0-b535-5531cdf5df0d tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:27.282431 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28d10313-bf81-42e0-b535-5531cdf5df0d tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:27.282969 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28d10313-bf81-42e0-b535-5531cdf5df0d tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:27.283360 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28d10313-bf81-42e0-b535-5531cdf5df0d tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:27.284201 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28d10313-bf81-42e0-b535-5531cdf5df0d tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:27.284503 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28d10313-bf81-42e0-b535-5531cdf5df0d tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:27.284929 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28d10313-bf81-42e0-b535-5531cdf5df0d tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:27.311477 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-28d10313-bf81-42e0-b535-5531cdf5df0d tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:39:27.388839 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-28d10313-bf81-42e0-b535-5531cdf5df0d tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "DELETE /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379" status: 204 len: 0 microversion: 2.1 time: 0.118333 Oct 17 04:39:27.389603 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 460/907] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:39:27 2022] DELETE /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:39:27.398413 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7ba326c4-d7b2-457a-ba28-335acc18c52b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:27.399057 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7ba326c4-d7b2-457a-ba28-335acc18c52b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:27.405376 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ba326c4-d7b2-457a-ba28-335acc18c52b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:27.405804 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ba326c4-d7b2-457a-ba28-335acc18c52b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:27.406239 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ba326c4-d7b2-457a-ba28-335acc18c52b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:27.406921 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ba326c4-d7b2-457a-ba28-335acc18c52b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:27.407374 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ba326c4-d7b2-457a-ba28-335acc18c52b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:27.407792 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7ba326c4-d7b2-457a-ba28-335acc18c52b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:27.485293 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8a943471-05e4-4915-9d38-bec75528daef tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:27.486073 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8a943471-05e4-4915-9d38-bec75528daef tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:27.493000 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a943471-05e4-4915-9d38-bec75528daef tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:27.493639 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a943471-05e4-4915-9d38-bec75528daef tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:27.494171 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a943471-05e4-4915-9d38-bec75528daef tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:27.494963 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a943471-05e4-4915-9d38-bec75528daef tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:27.495622 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a943471-05e4-4915-9d38-bec75528daef tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:27.496147 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8a943471-05e4-4915-9d38-bec75528daef tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:27.583364 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-7ba326c4-d7b2-457a-ba28-335acc18c52b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:27.592505 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7ba326c4-d7b2-457a-ba28-335acc18c52b tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379" status: 200 len: 1514 microversion: 2.1 time: 0.198346 Oct 17 04:39:27.593937 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 448/908] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:27 2022] GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379 => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:39:27.653319 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-8a943471-05e4-4915-9d38-bec75528daef tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:27.663537 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8a943471-05e4-4915-9d38-bec75528daef tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1266 microversion: 2.1 time: 0.182660 Oct 17 04:39:27.664122 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 461/909] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:27 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:39:28.616866 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a5d0ad6a-ad46-4c97-851e-abff64685f46 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:28.617495 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a5d0ad6a-ad46-4c97-851e-abff64685f46 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:28.623887 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5d0ad6a-ad46-4c97-851e-abff64685f46 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:28.624357 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5d0ad6a-ad46-4c97-851e-abff64685f46 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:28.624787 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5d0ad6a-ad46-4c97-851e-abff64685f46 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:28.625496 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5d0ad6a-ad46-4c97-851e-abff64685f46 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:28.625944 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5d0ad6a-ad46-4c97-851e-abff64685f46 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:28.627366 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a5d0ad6a-ad46-4c97-851e-abff64685f46 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:28.686573 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-c0241cdf-bcdc-4158-ade3-bc57fe36bf2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:28.687412 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-c0241cdf-bcdc-4158-ade3-bc57fe36bf2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:28.699984 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0241cdf-bcdc-4158-ade3-bc57fe36bf2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:28.700574 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0241cdf-bcdc-4158-ade3-bc57fe36bf2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:28.701146 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0241cdf-bcdc-4158-ade3-bc57fe36bf2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:28.701996 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0241cdf-bcdc-4158-ade3-bc57fe36bf2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:28.702792 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0241cdf-bcdc-4158-ade3-bc57fe36bf2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:28.703291 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-c0241cdf-bcdc-4158-ade3-bc57fe36bf2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:28.806449 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-a5d0ad6a-ad46-4c97-851e-abff64685f46 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:28.814709 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a5d0ad6a-ad46-4c97-851e-abff64685f46 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379" status: 200 len: 1514 microversion: 2.1 time: 0.202813 Oct 17 04:39:28.815281 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 449/910] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:28 2022] GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379 => generated 1514 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:28.870816 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-c0241cdf-bcdc-4158-ade3-bc57fe36bf2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:28.878714 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-c0241cdf-bcdc-4158-ade3-bc57fe36bf2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1266 microversion: 2.1 time: 0.196014 Oct 17 04:39:28.879388 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 462/911] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:28 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:39:29.837971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b468af5f-b2c0-4398-aee9-3d2a4b61c5b1 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:29.838587 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b468af5f-b2c0-4398-aee9-3d2a4b61c5b1 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:29.845116 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b468af5f-b2c0-4398-aee9-3d2a4b61c5b1 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:29.845604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b468af5f-b2c0-4398-aee9-3d2a4b61c5b1 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:29.846040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b468af5f-b2c0-4398-aee9-3d2a4b61c5b1 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:29.846730 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b468af5f-b2c0-4398-aee9-3d2a4b61c5b1 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:29.847182 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b468af5f-b2c0-4398-aee9-3d2a4b61c5b1 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:29.848084 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b468af5f-b2c0-4398-aee9-3d2a4b61c5b1 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:29.901409 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-03a475d9-a7ad-4bf0-b4e8-af80f0ffe508 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:29.902221 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-03a475d9-a7ad-4bf0-b4e8-af80f0ffe508 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:29.908663 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03a475d9-a7ad-4bf0-b4e8-af80f0ffe508 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:29.909264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03a475d9-a7ad-4bf0-b4e8-af80f0ffe508 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:29.909786 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03a475d9-a7ad-4bf0-b4e8-af80f0ffe508 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:29.911131 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03a475d9-a7ad-4bf0-b4e8-af80f0ffe508 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:29.911676 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03a475d9-a7ad-4bf0-b4e8-af80f0ffe508 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:29.912180 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-03a475d9-a7ad-4bf0-b4e8-af80f0ffe508 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:30.018801 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-b468af5f-b2c0-4398-aee9-3d2a4b61c5b1 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:30.027526 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b468af5f-b2c0-4398-aee9-3d2a4b61c5b1 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379" status: 200 len: 1514 microversion: 2.1 time: 0.193367 Oct 17 04:39:30.028107 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 450/912] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:29 2022] GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379 => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:30.067293 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-03a475d9-a7ad-4bf0-b4e8-af80f0ffe508 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:30.074945 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-03a475d9-a7ad-4bf0-b4e8-af80f0ffe508 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1266 microversion: 2.1 time: 0.177443 Oct 17 04:39:30.075510 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 463/913] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:29 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:39:31.052009 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-64c5796f-de27-483f-a159-b808b62e2812 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:31.052784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-64c5796f-de27-483f-a159-b808b62e2812 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:31.059327 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64c5796f-de27-483f-a159-b808b62e2812 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:31.059803 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64c5796f-de27-483f-a159-b808b62e2812 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:31.060231 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64c5796f-de27-483f-a159-b808b62e2812 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:31.060920 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64c5796f-de27-483f-a159-b808b62e2812 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:31.061392 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64c5796f-de27-483f-a159-b808b62e2812 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:31.061808 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-64c5796f-de27-483f-a159-b808b62e2812 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:31.100440 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0a140dbc-762c-4d7a-a7bb-e6da3294f267 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:31.101696 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0a140dbc-762c-4d7a-a7bb-e6da3294f267 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:31.109252 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a140dbc-762c-4d7a-a7bb-e6da3294f267 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:31.109897 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a140dbc-762c-4d7a-a7bb-e6da3294f267 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:31.110446 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a140dbc-762c-4d7a-a7bb-e6da3294f267 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:31.111318 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a140dbc-762c-4d7a-a7bb-e6da3294f267 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:31.111906 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a140dbc-762c-4d7a-a7bb-e6da3294f267 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:31.112438 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0a140dbc-762c-4d7a-a7bb-e6da3294f267 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:31.257207 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-64c5796f-de27-483f-a159-b808b62e2812 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:31.264873 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-64c5796f-de27-483f-a159-b808b62e2812 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379" status: 200 len: 1514 microversion: 2.1 time: 0.217943 Oct 17 04:39:31.265492 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 451/914] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:31 2022] GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379 => generated 1514 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:31.279971 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-0a140dbc-762c-4d7a-a7bb-e6da3294f267 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:31.288962 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0a140dbc-762c-4d7a-a7bb-e6da3294f267 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1452 microversion: 2.1 time: 0.194333 Oct 17 04:39:31.289581 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 464/915] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:31 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1452 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:31.311908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e9a4eda9-bdde-40c4-8396-54ecce0e525c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:31.312515 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e9a4eda9-bdde-40c4-8396-54ecce0e525c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:31.318600 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9a4eda9-bdde-40c4-8396-54ecce0e525c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:31.319076 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9a4eda9-bdde-40c4-8396-54ecce0e525c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:31.319512 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9a4eda9-bdde-40c4-8396-54ecce0e525c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:31.320194 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9a4eda9-bdde-40c4-8396-54ecce0e525c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:31.320641 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9a4eda9-bdde-40c4-8396-54ecce0e525c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:31.321063 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e9a4eda9-bdde-40c4-8396-54ecce0e525c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:31.449872 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e9a4eda9-bdde-40c4-8396-54ecce0e525c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:31.457686 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e9a4eda9-bdde-40c4-8396-54ecce0e525c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1452 microversion: 2.1 time: 0.149562 Oct 17 04:39:31.458256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 452/916] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:31 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:32.146344 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-5d147beb-a640-4ca7-9a9c-401eea541d81 req-9d22699c-1a27-4645-8edf-a70d93b7abe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ac795f-3972-41bd-b28f-8ddf3990a379", "name": "network-vif-deleted", "tag": "4b85bbb5-c664-41f0-b1ec-715507c7f011"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:39:32.175038 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5d147beb-a640-4ca7-9a9c-401eea541d81 req-9d22699c-1a27-4645-8edf-a70d93b7abe3 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:32.175530 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5d147beb-a640-4ca7-9a9c-401eea541d81 req-9d22699c-1a27-4645-8edf-a70d93b7abe3 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:32.176772 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-5d147beb-a640-4ca7-9a9c-401eea541d81 req-9d22699c-1a27-4645-8edf-a70d93b7abe3 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:32.200552 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-5d147beb-a640-4ca7-9a9c-401eea541d81 req-9d22699c-1a27-4645-8edf-a70d93b7abe3 service nova] Creating event network-vif-deleted:4b85bbb5-c664-41f0-b1ec-715507c7f011 for instance 32ac795f-3972-41bd-b28f-8ddf3990a379 on hv-cinder-86155 Oct 17 04:39:32.206161 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-5d147beb-a640-4ca7-9a9c-401eea541d81 req-9d22699c-1a27-4645-8edf-a70d93b7abe3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063553 Oct 17 04:39:32.207584 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 465/917] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:39:32.289231 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fe665b34-654c-4dfa-a476-53259296baf8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:32.290395 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fe665b34-654c-4dfa-a476-53259296baf8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:32.297120 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe665b34-654c-4dfa-a476-53259296baf8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:32.297674 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe665b34-654c-4dfa-a476-53259296baf8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:32.298324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe665b34-654c-4dfa-a476-53259296baf8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:32.299234 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe665b34-654c-4dfa-a476-53259296baf8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:32.299690 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe665b34-654c-4dfa-a476-53259296baf8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:32.300218 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe665b34-654c-4dfa-a476-53259296baf8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:32.336487 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe665b34-654c-4dfa-a476-53259296baf8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:32.337003 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe665b34-654c-4dfa-a476-53259296baf8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:32.337524 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe665b34-654c-4dfa-a476-53259296baf8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:32.337970 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-fe665b34-654c-4dfa-a476-53259296baf8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lazy-loading 'fault' on Instance uuid 32ac795f-3972-41bd-b28f-8ddf3990a379 {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:39:32.406230 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-fe665b34-654c-4dfa-a476-53259296baf8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bf7dc32577492885ce2892454e53b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ea82d88b2c4a7b8bf597bd83a02287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:39:32.414586 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fe665b34-654c-4dfa-a476-53259296baf8 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379" status: 200 len: 1309 microversion: 2.1 time: 0.130588 Oct 17 04:39:32.415158 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 453/918] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:32 2022] GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379 => generated 1309 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:39:33.449363 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5fb3b204-0662-491a-8883-45ce9a8c6352 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:39:33.449363 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5fb3b204-0662-491a-8883-45ce9a8c6352 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] [instance: 32ac795f-3972-41bd-b28f-8ddf3990a379] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:39:33.449363 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fb3b204-0662-491a-8883-45ce9a8c6352 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:33.449363 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fb3b204-0662-491a-8883-45ce9a8c6352 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:33.450043 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fb3b204-0662-491a-8883-45ce9a8c6352 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:33.450043 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fb3b204-0662-491a-8883-45ce9a8c6352 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:33.450043 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fb3b204-0662-491a-8883-45ce9a8c6352 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:33.450043 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5fb3b204-0662-491a-8883-45ce9a8c6352 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:33.475297 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-5fb3b204-0662-491a-8883-45ce9a8c6352 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] HTTP exception thrown: Instance 32ac795f-3972-41bd-b28f-8ddf3990a379 could not be found. Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5fb3b204-0662-491a-8883-45ce9a8c6352 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Request method failure captured: Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379 HTTP/1.1 Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNwYReCoH77Al4qXnWNB1UjPp9x-BD5lidB5NV5F0Odw1jiEwjnTgSNzJa4USacL5-VTx6GYfHKSFQVcDktmu4vh_7jzbARcTGneJJ7YSJc9IkSR-BH02OCsjrx1xyo_-Pfu7noipk5HLQVKFBd4oXTHCHNar1Xh8gMbDlgSox9Cu0I Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: 93ea82d88b2c4a7b8bf597bd83a02287 Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-VolumesSnapshotTestJSON-401976650 Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:39:33.477643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:39:33.479374 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/93ea82d88b2c4a7b8bf597bd83a02287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_93ea82d88b2c4a7b8bf597bd83a02287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/93ea82d88b2c4a7b8bf597bd83a02287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/93ea82d88b2c4a7b8bf597bd83a02287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:39:33.479374 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-VolumesSnapshotTestJSON-401976650 Oct 17 04:39:33.479374 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: 93ea82d88b2c4a7b8bf597bd83a02287 Oct 17 04:39:33.479374 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-401976650 Oct 17 04:39:33.479374 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-VolumesSnapshotTestJSON-401976650-project Oct 17 04:39:33.479374 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:39:33.479374 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:39:33.479374 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 41bf7dc32577492885ce2892454e53b2 Oct 17 04:39:33.479374 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-VolumesSnapshotTestJSON-401976650-project Oct 17 04:39:33.479374 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:39:33.479374 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance 32ac795f-3972-41bd-b28f-8ddf3990a379 could not be found. Oct 17 04:39:33.479374 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': '32ac795f-3972-41bd-b28f-8ddf3990a379'} Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32ac795f-3972-41bd-b28f-8ddf3990a379 could not be found. Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:39:33.480810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:39:33.483819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:39:33.483819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:39:33.483819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:39:33.483819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:39:33.483819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:39:33.483819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:39:33.483819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:39:33.483819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32ac795f-3972-41bd-b28f-8ddf3990a379 could not be found. Oct 17 04:39:33.483819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:39:33.483819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:39:33.483819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:39:33.483819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:39:33.483819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:39:33.483819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:39:33.483819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:39:33.483819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:39:33.483819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32ac795f-3972-41bd-b28f-8ddf3990a379 could not be found. Oct 17 04:39:33.483819 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:39:33.487021 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5fb3b204-0662-491a-8883-45ce9a8c6352 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] Returning 404 to user: Instance 32ac795f-3972-41bd-b28f-8ddf3990a379 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:39:33.488279 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5fb3b204-0662-491a-8883-45ce9a8c6352 tempest-VolumesSnapshotTestJSON-401976650 tempest-VolumesSnapshotTestJSON-401976650-project] 10.222.0.40 "GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379" status: 404 len: 111 microversion: 2.1 time: 0.054459 Oct 17 04:39:33.489744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 466/919] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:39:33 2022] GET /compute/v2.1/servers/32ac795f-3972-41bd-b28f-8ddf3990a379 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:39:33.810740 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-9f51303b-834c-4b50-bfe8-6c7209fde92c req-267768a5-84ea-4388-93f3-7c5f6080386d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed045a1c-3978-4818-8ea0-9ee3711acd79", "tag": "f723b755-7765-47ee-b1b3-a93d16d5f472"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:39:33.829953 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9f51303b-834c-4b50-bfe8-6c7209fde92c req-267768a5-84ea-4388-93f3-7c5f6080386d service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:39:33.831599 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9f51303b-834c-4b50-bfe8-6c7209fde92c req-267768a5-84ea-4388-93f3-7c5f6080386d service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:39:33.833017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-9f51303b-834c-4b50-bfe8-6c7209fde92c req-267768a5-84ea-4388-93f3-7c5f6080386d service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:39:33.849522 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-9f51303b-834c-4b50-bfe8-6c7209fde92c req-267768a5-84ea-4388-93f3-7c5f6080386d service nova] Creating event network-changed:f723b755-7765-47ee-b1b3-a93d16d5f472 for instance ed045a1c-3978-4818-8ea0-9ee3711acd79 on hv-cinder-86155 Oct 17 04:39:33.865484 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-9f51303b-834c-4b50-bfe8-6c7209fde92c req-267768a5-84ea-4388-93f3-7c5f6080386d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060054 Oct 17 04:39:33.866952 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 454/920] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:40:16.981589 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-832018f5-bb4a-4b86-9013-11a1c6e1f07b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Action: 'create', calling method: .version_select at 0x7fc630dcb280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1638242677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaJH+fXVGKX/6Pb/I37tAZI8IgklhoL06hSzIatTGoNx6hM3YI+LadAwIpR98FSp6d7naH7hHsBeDwLu0wm5RGl2q5zKQoQTKVEcCqj9BElBumtUYX2CPwwB7uK4Gu9Mg=="}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:40:16.987696 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:40:16.988348 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:40:17.002909 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-832018f5-bb4a-4b86-9013-11a1c6e1f07b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Getting quotas for project fa613028ef8e48df8eb7178c54926095. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:40:17.007196 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-832018f5-bb4a-4b86-9013-11a1c6e1f07b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Getting quotas for user c7d3b6f659c3404996aea8de61ad332c and project fa613028ef8e48df8eb7178c54926095. Resources: {'key_pairs'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:40:17.030274 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-832018f5-bb4a-4b86-9013-11a1c6e1f07b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052954 Oct 17 04:40:17.030870 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 467/921] 10.222.0.40 () {60 vars in 1159 bytes} [Mon Oct 17 04:40:16 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:40:17.080585 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:40:17.081350 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:40:17.086028 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0f18431e-f03a-4e01-88d0-e38bdeb16ce0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1217211137", "imageRef": "717d9203-b9da-4316-8252-545ab31910de", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1638242677", "networks": [{"uuid": "bd6540fe-f5bd-47b7-b95a-8ab656f32388"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:40:17.140653 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-0f18431e-f03a-4e01-88d0-e38bdeb16ce0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] validate_networks() for [('bd6540fe-f5bd-47b7-b95a-8ab656f32388', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:40:17.502505 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0f18431e-f03a-4e01-88d0-e38bdeb16ce0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:40:17.502930 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0f18431e-f03a-4e01-88d0-e38bdeb16ce0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:40:17.503403 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0f18431e-f03a-4e01-88d0-e38bdeb16ce0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:40:17.503851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0f18431e-f03a-4e01-88d0-e38bdeb16ce0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:40:17.504267 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-0f18431e-f03a-4e01-88d0-e38bdeb16ce0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:40:17.513775 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f18431e-f03a-4e01-88d0-e38bdeb16ce0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:17.514308 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f18431e-f03a-4e01-88d0-e38bdeb16ce0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:17.514685 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f18431e-f03a-4e01-88d0-e38bdeb16ce0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:17.515406 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f18431e-f03a-4e01-88d0-e38bdeb16ce0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:17.515857 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f18431e-f03a-4e01-88d0-e38bdeb16ce0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:17.516286 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0f18431e-f03a-4e01-88d0-e38bdeb16ce0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:17.532751 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-0f18431e-f03a-4e01-88d0-e38bdeb16ce0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Getting quotas for project fa613028ef8e48df8eb7178c54926095. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:40:17.536662 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-0f18431e-f03a-4e01-88d0-e38bdeb16ce0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Getting quotas for user c7d3b6f659c3404996aea8de61ad332c and project fa613028ef8e48df8eb7178c54926095. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:40:17.548005 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0f18431e-f03a-4e01-88d0-e38bdeb16ce0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:40:17.550339 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0f18431e-f03a-4e01-88d0-e38bdeb16ce0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='717d9203-b9da-4316-8252-545ab31910de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:40:17.595638 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0f18431e-f03a-4e01-88d0-e38bdeb16ce0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517694 Oct 17 04:40:17.596297 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 455/922] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:40:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 04:40:17.607736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a46f8c89-b161-439c-a95c-ab41d7ddb207 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:17.608357 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a46f8c89-b161-439c-a95c-ab41d7ddb207 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:17.662733 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a46f8c89-b161-439c-a95c-ab41d7ddb207 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:17.674134 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a46f8c89-b161-439c-a95c-ab41d7ddb207 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1259 microversion: 2.1 time: 0.070212 Oct 17 04:40:17.674762 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 468/923] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:17 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:40:18.697804 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ce131165-daa0-4527-9939-a2ebcb895ef3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:18.698454 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ce131165-daa0-4527-9939-a2ebcb895ef3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:18.704954 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce131165-daa0-4527-9939-a2ebcb895ef3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:18.705834 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce131165-daa0-4527-9939-a2ebcb895ef3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:18.706495 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce131165-daa0-4527-9939-a2ebcb895ef3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:18.707457 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce131165-daa0-4527-9939-a2ebcb895ef3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:18.708211 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce131165-daa0-4527-9939-a2ebcb895ef3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:18.708840 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ce131165-daa0-4527-9939-a2ebcb895ef3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:18.779934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-ce131165-daa0-4527-9939-a2ebcb895ef3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:18.787667 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ce131165-daa0-4527-9939-a2ebcb895ef3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1317 microversion: 2.1 time: 0.094631 Oct 17 04:40:18.788236 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 456/924] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:18 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1317 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:40:19.811367 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-05616039-f179-4dbf-bc1f-4bdc6457b0d3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:19.812023 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-05616039-f179-4dbf-bc1f-4bdc6457b0d3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:19.818690 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05616039-f179-4dbf-bc1f-4bdc6457b0d3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:19.819183 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05616039-f179-4dbf-bc1f-4bdc6457b0d3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:19.819626 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05616039-f179-4dbf-bc1f-4bdc6457b0d3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:19.820326 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05616039-f179-4dbf-bc1f-4bdc6457b0d3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:19.820960 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05616039-f179-4dbf-bc1f-4bdc6457b0d3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:19.821623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-05616039-f179-4dbf-bc1f-4bdc6457b0d3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:19.962764 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-05616039-f179-4dbf-bc1f-4bdc6457b0d3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:19.972000 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-05616039-f179-4dbf-bc1f-4bdc6457b0d3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1359 microversion: 2.1 time: 0.164659 Oct 17 04:40:19.972587 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 469/925] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:19 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:40:20.995633 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5fd8b96a-aead-4464-9d58-9e49f70f7c25 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:20.996364 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5fd8b96a-aead-4464-9d58-9e49f70f7c25 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:21.003068 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fd8b96a-aead-4464-9d58-9e49f70f7c25 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:21.003560 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fd8b96a-aead-4464-9d58-9e49f70f7c25 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:21.003997 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fd8b96a-aead-4464-9d58-9e49f70f7c25 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:21.004714 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fd8b96a-aead-4464-9d58-9e49f70f7c25 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:21.005195 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fd8b96a-aead-4464-9d58-9e49f70f7c25 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:21.005619 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5fd8b96a-aead-4464-9d58-9e49f70f7c25 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:21.141494 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-5fd8b96a-aead-4464-9d58-9e49f70f7c25 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:21.149405 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5fd8b96a-aead-4464-9d58-9e49f70f7c25 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1359 microversion: 2.1 time: 0.157718 Oct 17 04:40:21.150727 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 457/926] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:20 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:40:22.172635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e7b60f35-296a-4e25-a291-c03c20b72bd6 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:22.173298 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e7b60f35-296a-4e25-a291-c03c20b72bd6 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:22.179352 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7b60f35-296a-4e25-a291-c03c20b72bd6 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:22.179839 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7b60f35-296a-4e25-a291-c03c20b72bd6 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:22.180280 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7b60f35-296a-4e25-a291-c03c20b72bd6 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:22.181849 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7b60f35-296a-4e25-a291-c03c20b72bd6 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:22.182531 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7b60f35-296a-4e25-a291-c03c20b72bd6 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:22.183044 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e7b60f35-296a-4e25-a291-c03c20b72bd6 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:22.318238 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e7b60f35-296a-4e25-a291-c03c20b72bd6 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:22.326622 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e7b60f35-296a-4e25-a291-c03c20b72bd6 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1359 microversion: 2.1 time: 0.157788 Oct 17 04:40:22.327419 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 470/927] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:22 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:40:23.349464 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-08e7ae2c-f8d5-449b-a545-31c92f9d84a3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:23.350150 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-08e7ae2c-f8d5-449b-a545-31c92f9d84a3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:23.357400 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-08e7ae2c-f8d5-449b-a545-31c92f9d84a3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:23.358123 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-08e7ae2c-f8d5-449b-a545-31c92f9d84a3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:23.358332 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-08e7ae2c-f8d5-449b-a545-31c92f9d84a3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:23.359016 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-08e7ae2c-f8d5-449b-a545-31c92f9d84a3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:23.359465 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-08e7ae2c-f8d5-449b-a545-31c92f9d84a3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:23.359943 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-08e7ae2c-f8d5-449b-a545-31c92f9d84a3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:23.509644 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-08e7ae2c-f8d5-449b-a545-31c92f9d84a3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:23.517494 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-08e7ae2c-f8d5-449b-a545-31c92f9d84a3 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1359 microversion: 2.1 time: 0.171782 Oct 17 04:40:23.518072 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 458/928] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:23 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:40:24.541905 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e22a5a8e-1442-4e45-8633-f96fb07f599f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:24.542454 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e22a5a8e-1442-4e45-8633-f96fb07f599f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:24.549438 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e22a5a8e-1442-4e45-8633-f96fb07f599f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:24.549931 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e22a5a8e-1442-4e45-8633-f96fb07f599f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:24.550373 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e22a5a8e-1442-4e45-8633-f96fb07f599f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:24.551082 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e22a5a8e-1442-4e45-8633-f96fb07f599f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:24.551537 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e22a5a8e-1442-4e45-8633-f96fb07f599f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:24.551966 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e22a5a8e-1442-4e45-8633-f96fb07f599f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:24.697334 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e22a5a8e-1442-4e45-8633-f96fb07f599f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:24.705425 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e22a5a8e-1442-4e45-8633-f96fb07f599f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1359 microversion: 2.1 time: 0.168043 Oct 17 04:40:24.705998 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 471/929] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:24 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:40:25.732505 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-bf9dfee5-9106-4765-aa29-bdbe6d0a8492 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:25.733285 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-bf9dfee5-9106-4765-aa29-bdbe6d0a8492 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:25.740233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf9dfee5-9106-4765-aa29-bdbe6d0a8492 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:25.740921 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf9dfee5-9106-4765-aa29-bdbe6d0a8492 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:25.741372 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf9dfee5-9106-4765-aa29-bdbe6d0a8492 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:25.742070 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf9dfee5-9106-4765-aa29-bdbe6d0a8492 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:25.742522 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf9dfee5-9106-4765-aa29-bdbe6d0a8492 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:25.742945 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-bf9dfee5-9106-4765-aa29-bdbe6d0a8492 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:25.880358 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-bf9dfee5-9106-4765-aa29-bdbe6d0a8492 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:25.889454 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-bf9dfee5-9106-4765-aa29-bdbe6d0a8492 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1359 microversion: 2.1 time: 0.162085 Oct 17 04:40:25.890036 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 459/930] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:25 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:40:26.913345 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5f84873e-100d-4310-8d65-d15326f67301 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:26.913975 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5f84873e-100d-4310-8d65-d15326f67301 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:26.921324 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f84873e-100d-4310-8d65-d15326f67301 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:26.921800 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f84873e-100d-4310-8d65-d15326f67301 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:26.922228 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f84873e-100d-4310-8d65-d15326f67301 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:26.922912 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f84873e-100d-4310-8d65-d15326f67301 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:26.923363 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f84873e-100d-4310-8d65-d15326f67301 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:26.923809 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5f84873e-100d-4310-8d65-d15326f67301 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:27.054928 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5f84873e-100d-4310-8d65-d15326f67301 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:27.062752 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5f84873e-100d-4310-8d65-d15326f67301 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1359 microversion: 2.1 time: 0.153256 Oct 17 04:40:27.063330 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 472/931] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:26 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:40:27.661949 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:40:27.663576 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:40:27.669312 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-5fd6818c-155e-4798-99e6-e4c4c036584a req-215f1c12-8d3d-450b-b524-62e6de389868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2192d50d-fc32-4eb2-8028-df6b4844be8c", "tag": "f0f6ca07-b0d8-4ee0-9614-ddf606753cac"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:40:27.680432 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5fd6818c-155e-4798-99e6-e4c4c036584a req-215f1c12-8d3d-450b-b524-62e6de389868 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:27.681531 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5fd6818c-155e-4798-99e6-e4c4c036584a req-215f1c12-8d3d-450b-b524-62e6de389868 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:27.681963 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5fd6818c-155e-4798-99e6-e4c4c036584a req-215f1c12-8d3d-450b-b524-62e6de389868 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:27.693891 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-5fd6818c-155e-4798-99e6-e4c4c036584a req-215f1c12-8d3d-450b-b524-62e6de389868 service nova] Creating event network-changed:f0f6ca07-b0d8-4ee0-9614-ddf606753cac for instance 2192d50d-fc32-4eb2-8028-df6b4844be8c on hv-cinder-86155 Oct 17 04:40:27.698920 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-5fd6818c-155e-4798-99e6-e4c4c036584a req-215f1c12-8d3d-450b-b524-62e6de389868 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038117 Oct 17 04:40:27.699534 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 460/932] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:40:28.085598 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f9d5b042-c3a4-4057-ac63-8e5b8ea7b577 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:28.086211 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f9d5b042-c3a4-4057-ac63-8e5b8ea7b577 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:28.088403 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:40:28.094175 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9d5b042-c3a4-4057-ac63-8e5b8ea7b577 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:28.094656 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9d5b042-c3a4-4057-ac63-8e5b8ea7b577 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:28.095091 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9d5b042-c3a4-4057-ac63-8e5b8ea7b577 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:28.095783 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9d5b042-c3a4-4057-ac63-8e5b8ea7b577 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:28.096230 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9d5b042-c3a4-4057-ac63-8e5b8ea7b577 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:28.096651 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f9d5b042-c3a4-4057-ac63-8e5b8ea7b577 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:28.226217 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f9d5b042-c3a4-4057-ac63-8e5b8ea7b577 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:28.234373 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f9d5b042-c3a4-4057-ac63-8e5b8ea7b577 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1359 microversion: 2.1 time: 0.152585 Oct 17 04:40:28.234961 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 473/933] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:28 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:40:29.258573 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-174b1ad1-18a2-4d9d-8086-ab71e8257b27 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:29.259320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-174b1ad1-18a2-4d9d-8086-ab71e8257b27 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:29.265537 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-174b1ad1-18a2-4d9d-8086-ab71e8257b27 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:29.266040 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-174b1ad1-18a2-4d9d-8086-ab71e8257b27 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:29.266479 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-174b1ad1-18a2-4d9d-8086-ab71e8257b27 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:29.267168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-174b1ad1-18a2-4d9d-8086-ab71e8257b27 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:29.267617 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-174b1ad1-18a2-4d9d-8086-ab71e8257b27 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:29.268039 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-174b1ad1-18a2-4d9d-8086-ab71e8257b27 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:29.401023 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-174b1ad1-18a2-4d9d-8086-ab71e8257b27 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:29.408669 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-174b1ad1-18a2-4d9d-8086-ab71e8257b27 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1359 microversion: 2.1 time: 0.154817 Oct 17 04:40:29.409256 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 461/934] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:29 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:40:30.431813 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-18d8a572-4b14-449c-8d71-5718d11ae31f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:30.432349 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-18d8a572-4b14-449c-8d71-5718d11ae31f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:30.438791 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18d8a572-4b14-449c-8d71-5718d11ae31f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:30.439271 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18d8a572-4b14-449c-8d71-5718d11ae31f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:30.439706 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18d8a572-4b14-449c-8d71-5718d11ae31f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:30.440388 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18d8a572-4b14-449c-8d71-5718d11ae31f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:30.440839 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18d8a572-4b14-449c-8d71-5718d11ae31f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:30.441291 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-18d8a572-4b14-449c-8d71-5718d11ae31f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:30.569008 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-18d8a572-4b14-449c-8d71-5718d11ae31f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:30.577492 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-18d8a572-4b14-449c-8d71-5718d11ae31f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1359 microversion: 2.1 time: 0.149466 Oct 17 04:40:30.578313 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 474/935] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:30 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:40:31.600730 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f6534192-3f0e-41ed-a303-c1e43d7f7c2e tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:31.601370 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f6534192-3f0e-41ed-a303-c1e43d7f7c2e tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:31.608371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6534192-3f0e-41ed-a303-c1e43d7f7c2e tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:31.608850 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6534192-3f0e-41ed-a303-c1e43d7f7c2e tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:31.609320 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6534192-3f0e-41ed-a303-c1e43d7f7c2e tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:31.610016 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6534192-3f0e-41ed-a303-c1e43d7f7c2e tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:31.610472 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6534192-3f0e-41ed-a303-c1e43d7f7c2e tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:31.610900 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f6534192-3f0e-41ed-a303-c1e43d7f7c2e tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:31.773261 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f6534192-3f0e-41ed-a303-c1e43d7f7c2e tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:31.781572 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f6534192-3f0e-41ed-a303-c1e43d7f7c2e tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1359 microversion: 2.1 time: 0.184650 Oct 17 04:40:31.782134 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 462/936] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:31 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:40:32.805185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-b5e5745b-63f2-4f50-92cf-869c3bc22aeb tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:32.805891 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-b5e5745b-63f2-4f50-92cf-869c3bc22aeb tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:32.812386 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5e5745b-63f2-4f50-92cf-869c3bc22aeb tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:32.812870 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5e5745b-63f2-4f50-92cf-869c3bc22aeb tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:32.813337 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5e5745b-63f2-4f50-92cf-869c3bc22aeb tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:32.814039 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5e5745b-63f2-4f50-92cf-869c3bc22aeb tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:32.814488 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5e5745b-63f2-4f50-92cf-869c3bc22aeb tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:32.814909 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-b5e5745b-63f2-4f50-92cf-869c3bc22aeb tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:32.862616 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-0609cddc-b3b5-4c71-b732-e00e006cf5d9 req-6b97267b-07ec-4536-b32b-26db1c798550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2192d50d-fc32-4eb2-8028-df6b4844be8c", "name": "network-vif-plugged", "status": "completed", "tag": "f0f6ca07-b0d8-4ee0-9614-ddf606753cac"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:40:32.872853 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0609cddc-b3b5-4c71-b732-e00e006cf5d9 req-6b97267b-07ec-4536-b32b-26db1c798550 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:32.873643 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0609cddc-b3b5-4c71-b732-e00e006cf5d9 req-6b97267b-07ec-4536-b32b-26db1c798550 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:32.874108 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-0609cddc-b3b5-4c71-b732-e00e006cf5d9 req-6b97267b-07ec-4536-b32b-26db1c798550 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:32.886405 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-0609cddc-b3b5-4c71-b732-e00e006cf5d9 req-6b97267b-07ec-4536-b32b-26db1c798550 service nova] Creating event network-vif-plugged:f0f6ca07-b0d8-4ee0-9614-ddf606753cac for instance 2192d50d-fc32-4eb2-8028-df6b4844be8c on hv-cinder-86155 Oct 17 04:40:32.891255 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-0609cddc-b3b5-4c71-b732-e00e006cf5d9 req-6b97267b-07ec-4536-b32b-26db1c798550 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032238 Oct 17 04:40:32.892002 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 463/937] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:40:32.963100 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-b5e5745b-63f2-4f50-92cf-869c3bc22aeb tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:32.971074 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-b5e5745b-63f2-4f50-92cf-869c3bc22aeb tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1359 microversion: 2.1 time: 0.169819 Oct 17 04:40:32.971606 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 475/938] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:32 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:40:33.995186 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b770b912-6797-42f3-9ac3-62c04bf0b071 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:33.995887 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b770b912-6797-42f3-9ac3-62c04bf0b071 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:34.002049 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b770b912-6797-42f3-9ac3-62c04bf0b071 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:34.002529 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b770b912-6797-42f3-9ac3-62c04bf0b071 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:34.002969 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b770b912-6797-42f3-9ac3-62c04bf0b071 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:34.003666 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b770b912-6797-42f3-9ac3-62c04bf0b071 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:34.004120 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b770b912-6797-42f3-9ac3-62c04bf0b071 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:34.004546 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b770b912-6797-42f3-9ac3-62c04bf0b071 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:34.130435 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-b770b912-6797-42f3-9ac3-62c04bf0b071 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:34.139057 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b770b912-6797-42f3-9ac3-62c04bf0b071 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1359 microversion: 2.1 time: 0.148732 Oct 17 04:40:34.140027 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 464/939] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:33 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:40:35.163425 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2215068e-a8f3-412b-bc0f-1424262ec169 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:35.164043 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2215068e-a8f3-412b-bc0f-1424262ec169 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:35.170688 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2215068e-a8f3-412b-bc0f-1424262ec169 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:35.171175 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2215068e-a8f3-412b-bc0f-1424262ec169 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:35.171615 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2215068e-a8f3-412b-bc0f-1424262ec169 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:35.172308 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2215068e-a8f3-412b-bc0f-1424262ec169 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:35.172763 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2215068e-a8f3-412b-bc0f-1424262ec169 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:35.173231 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2215068e-a8f3-412b-bc0f-1424262ec169 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:35.303162 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-2215068e-a8f3-412b-bc0f-1424262ec169 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:35.310955 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2215068e-a8f3-412b-bc0f-1424262ec169 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1549 microversion: 2.1 time: 0.152533 Oct 17 04:40:35.311523 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 476/940] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:35 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:40:35.332747 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-430ae1a3-d26f-43ca-9fb8-9dc65181c622 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:35.333390 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-430ae1a3-d26f-43ca-9fb8-9dc65181c622 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:35.340125 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-430ae1a3-d26f-43ca-9fb8-9dc65181c622 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:35.340603 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-430ae1a3-d26f-43ca-9fb8-9dc65181c622 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:35.341047 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-430ae1a3-d26f-43ca-9fb8-9dc65181c622 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:35.341761 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-430ae1a3-d26f-43ca-9fb8-9dc65181c622 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:35.342212 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-430ae1a3-d26f-43ca-9fb8-9dc65181c622 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:35.342632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-430ae1a3-d26f-43ca-9fb8-9dc65181c622 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:35.469152 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-430ae1a3-d26f-43ca-9fb8-9dc65181c622 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:35.476738 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-430ae1a3-d26f-43ca-9fb8-9dc65181c622 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1549 microversion: 2.1 time: 0.147771 Oct 17 04:40:35.477337 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 465/941] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:35 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:40:35.499230 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3c6b3d94-620f-4bf1-a8db-c8622fa0c2b5 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:35.504207 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-3c6b3d94-620f-4bf1-a8db-c8622fa0c2b5 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:35.504969 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3c6b3d94-620f-4bf1-a8db-c8622fa0c2b5 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Searching by: {'deleted': False, 'project_id': 'fa613028ef8e48df8eb7178c54926095'} {{(pid=119127) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 04:40:35.511709 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c6b3d94-620f-4bf1-a8db-c8622fa0c2b5 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:35.512190 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c6b3d94-620f-4bf1-a8db-c8622fa0c2b5 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:35.512659 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c6b3d94-620f-4bf1-a8db-c8622fa0c2b5 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:35.513411 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c6b3d94-620f-4bf1-a8db-c8622fa0c2b5 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:35.513867 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c6b3d94-620f-4bf1-a8db-c8622fa0c2b5 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:35.514291 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3c6b3d94-620f-4bf1-a8db-c8622fa0c2b5 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:35.603500 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.multi_cell_list [None req-3c6b3d94-620f-4bf1-a8db-c8622fa0c2b5 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 04:40:35.699092 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3c6b3d94-620f-4bf1-a8db-c8622fa0c2b5 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203588 Oct 17 04:40:35.699589 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 477/942] 10.222.0.40 () {58 vars in 1125 bytes} [Mon Oct 17 04:40:35 2022] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:40:35.711372 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1fc05a89-5158-49df-8336-1c4cb41f6100 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:35.711987 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1fc05a89-5158-49df-8336-1c4cb41f6100 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:35.717953 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fc05a89-5158-49df-8336-1c4cb41f6100 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:35.718435 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fc05a89-5158-49df-8336-1c4cb41f6100 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:35.718873 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fc05a89-5158-49df-8336-1c4cb41f6100 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:35.719564 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fc05a89-5158-49df-8336-1c4cb41f6100 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:35.720018 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fc05a89-5158-49df-8336-1c4cb41f6100 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:35.720442 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1fc05a89-5158-49df-8336-1c4cb41f6100 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:35.849243 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-1fc05a89-5158-49df-8336-1c4cb41f6100 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:35.857420 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1fc05a89-5158-49df-8336-1c4cb41f6100 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1549 microversion: 2.1 time: 0.149842 Oct 17 04:40:35.857982 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 466/943] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:35 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:40:37.399150 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-105a74eb-02c3-4217-be3f-27191fe25de0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cb440a9-3fdb-4c83-b7d8-b0f6f549eefc"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:40:37.402149 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-105a74eb-02c3-4217-be3f-27191fe25de0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:37.408508 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-105a74eb-02c3-4217-be3f-27191fe25de0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:37.408989 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-105a74eb-02c3-4217-be3f-27191fe25de0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:37.409474 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-105a74eb-02c3-4217-be3f-27191fe25de0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:37.410161 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-105a74eb-02c3-4217-be3f-27191fe25de0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:37.410642 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-105a74eb-02c3-4217-be3f-27191fe25de0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:37.411064 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-105a74eb-02c3-4217-be3f-27191fe25de0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:37.818024 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-105a74eb-02c3-4217-be3f-27191fe25de0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "POST /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.422435 Oct 17 04:40:37.818629 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 478/944] 10.222.0.40 () {60 vars in 1323 bytes} [Mon Oct 17 04:40:37 2022] POST /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:40:44.346239 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6286cc7d-6fee-4724-a772-74b87ae151b0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:44.346854 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6286cc7d-6fee-4724-a772-74b87ae151b0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:44.352881 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6286cc7d-6fee-4724-a772-74b87ae151b0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:44.353385 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6286cc7d-6fee-4724-a772-74b87ae151b0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:44.353822 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6286cc7d-6fee-4724-a772-74b87ae151b0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:44.354509 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6286cc7d-6fee-4724-a772-74b87ae151b0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:44.354959 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6286cc7d-6fee-4724-a772-74b87ae151b0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:44.355381 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6286cc7d-6fee-4724-a772-74b87ae151b0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:44.481248 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-6286cc7d-6fee-4724-a772-74b87ae151b0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:44.489407 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6286cc7d-6fee-4724-a772-74b87ae151b0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1595 microversion: 2.1 time: 0.147009 Oct 17 04:40:44.489911 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 467/945] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:44 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1595 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:40:46.139852 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-3d0421ab-a981-4d5b-aca2-38218ee84e94 req-d5fc3d47-0131-46af-848b-fb54081256c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2192d50d-fc32-4eb2-8028-df6b4844be8c", "tag": "f0f6ca07-b0d8-4ee0-9614-ddf606753cac"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:40:46.160952 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:40:46.166205 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3d0421ab-a981-4d5b-aca2-38218ee84e94 req-d5fc3d47-0131-46af-848b-fb54081256c0 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:46.166693 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3d0421ab-a981-4d5b-aca2-38218ee84e94 req-d5fc3d47-0131-46af-848b-fb54081256c0 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:46.167124 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3d0421ab-a981-4d5b-aca2-38218ee84e94 req-d5fc3d47-0131-46af-848b-fb54081256c0 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:46.179726 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-3d0421ab-a981-4d5b-aca2-38218ee84e94 req-d5fc3d47-0131-46af-848b-fb54081256c0 service nova] Creating event network-changed:f0f6ca07-b0d8-4ee0-9614-ddf606753cac for instance 2192d50d-fc32-4eb2-8028-df6b4844be8c on hv-cinder-86155 Oct 17 04:40:46.186187 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-3d0421ab-a981-4d5b-aca2-38218ee84e94 req-d5fc3d47-0131-46af-848b-fb54081256c0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050330 Oct 17 04:40:46.187034 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 479/946] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:40:47.205897 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-6a6a8532-a5f9-4859-9d2f-2ec0bca62771 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1773030672"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:40:47.206437 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-6a6a8532-a5f9-4859-9d2f-2ec0bca62771 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:47.208847 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:40:47.214802 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a6a8532-a5f9-4859-9d2f-2ec0bca62771 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:47.215290 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a6a8532-a5f9-4859-9d2f-2ec0bca62771 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:47.215723 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a6a8532-a5f9-4859-9d2f-2ec0bca62771 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:47.216420 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a6a8532-a5f9-4859-9d2f-2ec0bca62771 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:47.216877 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a6a8532-a5f9-4859-9d2f-2ec0bca62771 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:47.217328 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-6a6a8532-a5f9-4859-9d2f-2ec0bca62771 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:47.221525 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=67 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:40:47.349499 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.network.security_group_api [None req-6a6a8532-a5f9-4859-9d2f-2ec0bca62771 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Adding security group 2aedb6d8-1729-4ae3-a30a-dfbac6e19228 to port f0f6ca07-b0d8-4ee0-9614-ddf606753cac Oct 17 04:40:47.658966 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-6a6a8532-a5f9-4859-9d2f-2ec0bca62771 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "POST /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c/action" status: 202 len: 0 microversion: 2.1 time: 0.457200 Oct 17 04:40:47.659574 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 468/947] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Oct 17 04:40:47 2022] POST /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:40:47.669775 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-de5e47a1-d41e-4b44-a28f-3d57eb8bdf86 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:40:47.670727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-de5e47a1-d41e-4b44-a28f-3d57eb8bdf86 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:40:47.676627 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:40:47.678264 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de5e47a1-d41e-4b44-a28f-3d57eb8bdf86 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:47.679333 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de5e47a1-d41e-4b44-a28f-3d57eb8bdf86 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:47.679474 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de5e47a1-d41e-4b44-a28f-3d57eb8bdf86 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:47.680067 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de5e47a1-d41e-4b44-a28f-3d57eb8bdf86 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:47.682206 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de5e47a1-d41e-4b44-a28f-3d57eb8bdf86 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:47.682821 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-de5e47a1-d41e-4b44-a28f-3d57eb8bdf86 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:47.687832 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:40:48.090770 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-de5e47a1-d41e-4b44-a28f-3d57eb8bdf86 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:40:48.098851 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-de5e47a1-d41e-4b44-a28f-3d57eb8bdf86 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1760 microversion: 2.1 time: 0.434787 Oct 17 04:40:48.099418 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 480/948] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:40:47 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1760 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:40:48.201268 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-5b880f41-3f0b-496b-9ac9-3f07e107d089 req-abb564ce-6e88-4a67-91c1-cd207b21c5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2192d50d-fc32-4eb2-8028-df6b4844be8c", "tag": "f0f6ca07-b0d8-4ee0-9614-ddf606753cac"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:40:48.211189 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5b880f41-3f0b-496b-9ac9-3f07e107d089 req-abb564ce-6e88-4a67-91c1-cd207b21c5e8 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:40:48.212348 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5b880f41-3f0b-496b-9ac9-3f07e107d089 req-abb564ce-6e88-4a67-91c1-cd207b21c5e8 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:40:48.213185 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5b880f41-3f0b-496b-9ac9-3f07e107d089 req-abb564ce-6e88-4a67-91c1-cd207b21c5e8 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:40:48.224440 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-5b880f41-3f0b-496b-9ac9-3f07e107d089 req-abb564ce-6e88-4a67-91c1-cd207b21c5e8 service nova] Creating event network-changed:f0f6ca07-b0d8-4ee0-9614-ddf606753cac for instance 2192d50d-fc32-4eb2-8028-df6b4844be8c on hv-cinder-86155 Oct 17 04:40:48.229867 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-5b880f41-3f0b-496b-9ac9-3f07e107d089 req-abb564ce-6e88-4a67-91c1-cd207b21c5e8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032922 Oct 17 04:40:48.230460 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 469/949] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 04:41:10.818878 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-ac31a25a-33b7-4278-96a5-ba5960b4729f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:41:10.821203 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-ac31a25a-33b7-4278-96a5-ba5960b4729f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:10.824124 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:41:10.824760 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=5 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:41:10.830946 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac31a25a-33b7-4278-96a5-ba5960b4729f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:10.831425 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac31a25a-33b7-4278-96a5-ba5960b4729f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:10.831868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac31a25a-33b7-4278-96a5-ba5960b4729f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:10.832555 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac31a25a-33b7-4278-96a5-ba5960b4729f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:10.833006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac31a25a-33b7-4278-96a5-ba5960b4729f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:10.833450 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-ac31a25a-33b7-4278-96a5-ba5960b4729f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:10.906179 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-ac31a25a-33b7-4278-96a5-ba5960b4729f tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "POST /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c/action" status: 202 len: 0 microversion: 2.1 time: 0.091104 Oct 17 04:41:10.906796 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 481/950] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Oct 17 04:41:10 2022] POST /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:41:10.912835 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:41:10.913584 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=5 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:41:10.917998 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e3f2555f-141f-44df-af90-a6b26232780b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:10.918699 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e3f2555f-141f-44df-af90-a6b26232780b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:10.925748 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3f2555f-141f-44df-af90-a6b26232780b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:10.926225 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3f2555f-141f-44df-af90-a6b26232780b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:10.926659 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3f2555f-141f-44df-af90-a6b26232780b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:10.927371 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3f2555f-141f-44df-af90-a6b26232780b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:10.927864 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3f2555f-141f-44df-af90-a6b26232780b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:10.928344 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e3f2555f-141f-44df-af90-a6b26232780b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:11.079547 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e3f2555f-141f-44df-af90-a6b26232780b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:11.088041 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e3f2555f-141f-44df-af90-a6b26232780b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1752 microversion: 2.1 time: 0.176735 Oct 17 04:41:11.089448 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 470/951] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:10 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:12.112608 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0f072f91-2f18-4a51-92eb-d7adf0e24115 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:12.113372 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0f072f91-2f18-4a51-92eb-d7adf0e24115 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:12.119403 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f072f91-2f18-4a51-92eb-d7adf0e24115 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:12.120424 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f072f91-2f18-4a51-92eb-d7adf0e24115 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:12.121427 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f072f91-2f18-4a51-92eb-d7adf0e24115 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:12.122129 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f072f91-2f18-4a51-92eb-d7adf0e24115 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:12.122580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f072f91-2f18-4a51-92eb-d7adf0e24115 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:12.123006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0f072f91-2f18-4a51-92eb-d7adf0e24115 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:12.396956 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-0f072f91-2f18-4a51-92eb-d7adf0e24115 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:12.405751 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0f072f91-2f18-4a51-92eb-d7adf0e24115 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1757 microversion: 2.1 time: 0.297813 Oct 17 04:41:12.406321 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 482/952] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:12 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1757 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:13.429936 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-637fefc8-324b-4cea-9603-53e6b15a70a1 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:13.430538 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-637fefc8-324b-4cea-9603-53e6b15a70a1 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:13.436946 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-637fefc8-324b-4cea-9603-53e6b15a70a1 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:13.437454 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-637fefc8-324b-4cea-9603-53e6b15a70a1 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:13.437882 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-637fefc8-324b-4cea-9603-53e6b15a70a1 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:13.438568 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-637fefc8-324b-4cea-9603-53e6b15a70a1 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:13.439011 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-637fefc8-324b-4cea-9603-53e6b15a70a1 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:13.439430 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-637fefc8-324b-4cea-9603-53e6b15a70a1 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:13.626597 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-637fefc8-324b-4cea-9603-53e6b15a70a1 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:13.634747 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-637fefc8-324b-4cea-9603-53e6b15a70a1 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1757 microversion: 2.1 time: 0.208907 Oct 17 04:41:13.635298 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 471/953] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:13 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1757 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:14.658163 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-12edb825-5e15-4687-984c-df8ef26c5862 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:14.658774 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-12edb825-5e15-4687-984c-df8ef26c5862 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:14.665159 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12edb825-5e15-4687-984c-df8ef26c5862 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:14.665639 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12edb825-5e15-4687-984c-df8ef26c5862 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:14.666069 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12edb825-5e15-4687-984c-df8ef26c5862 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:14.667618 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12edb825-5e15-4687-984c-df8ef26c5862 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:14.668137 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12edb825-5e15-4687-984c-df8ef26c5862 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:14.668560 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-12edb825-5e15-4687-984c-df8ef26c5862 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:14.811958 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-12edb825-5e15-4687-984c-df8ef26c5862 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:14.820040 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-12edb825-5e15-4687-984c-df8ef26c5862 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1757 microversion: 2.1 time: 0.165772 Oct 17 04:41:14.820597 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 483/954] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:14 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:15.843906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-50c7a150-e097-4d23-a9df-1f0de703b16b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:15.844523 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-50c7a150-e097-4d23-a9df-1f0de703b16b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:15.850928 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50c7a150-e097-4d23-a9df-1f0de703b16b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:15.851407 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50c7a150-e097-4d23-a9df-1f0de703b16b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:15.851842 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50c7a150-e097-4d23-a9df-1f0de703b16b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:15.852527 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50c7a150-e097-4d23-a9df-1f0de703b16b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:15.852976 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50c7a150-e097-4d23-a9df-1f0de703b16b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:15.853448 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-50c7a150-e097-4d23-a9df-1f0de703b16b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:15.992792 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-50c7a150-e097-4d23-a9df-1f0de703b16b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:16.001029 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-50c7a150-e097-4d23-a9df-1f0de703b16b tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1757 microversion: 2.1 time: 0.161051 Oct 17 04:41:16.001632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 472/955] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:15 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:17.026939 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-95d8f2b2-e0ad-4f32-a6a2-8d5655c7d08c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:17.027706 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-95d8f2b2-e0ad-4f32-a6a2-8d5655c7d08c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:17.034445 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95d8f2b2-e0ad-4f32-a6a2-8d5655c7d08c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:17.035041 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95d8f2b2-e0ad-4f32-a6a2-8d5655c7d08c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:17.035488 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95d8f2b2-e0ad-4f32-a6a2-8d5655c7d08c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:17.036200 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95d8f2b2-e0ad-4f32-a6a2-8d5655c7d08c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:17.036658 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95d8f2b2-e0ad-4f32-a6a2-8d5655c7d08c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:17.037095 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-95d8f2b2-e0ad-4f32-a6a2-8d5655c7d08c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:17.186402 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-95d8f2b2-e0ad-4f32-a6a2-8d5655c7d08c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:17.194790 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-95d8f2b2-e0ad-4f32-a6a2-8d5655c7d08c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1757 microversion: 2.1 time: 0.173649 Oct 17 04:41:17.195359 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 484/956] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:17 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:18.218575 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-def2e9d4-6d37-4325-83c7-6bc669f11db7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:18.219199 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-def2e9d4-6d37-4325-83c7-6bc669f11db7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:18.225686 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-def2e9d4-6d37-4325-83c7-6bc669f11db7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:18.226172 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-def2e9d4-6d37-4325-83c7-6bc669f11db7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:18.226615 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-def2e9d4-6d37-4325-83c7-6bc669f11db7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:18.227310 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-def2e9d4-6d37-4325-83c7-6bc669f11db7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:18.227767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-def2e9d4-6d37-4325-83c7-6bc669f11db7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:18.228193 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-def2e9d4-6d37-4325-83c7-6bc669f11db7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:18.370971 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-def2e9d4-6d37-4325-83c7-6bc669f11db7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:18.379177 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-def2e9d4-6d37-4325-83c7-6bc669f11db7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1757 microversion: 2.1 time: 0.164490 Oct 17 04:41:18.379748 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 473/957] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:18 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:19.402975 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-90c6cfcf-2e74-4385-9d59-62cf564ffcc7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:19.403555 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-90c6cfcf-2e74-4385-9d59-62cf564ffcc7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:19.409853 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90c6cfcf-2e74-4385-9d59-62cf564ffcc7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:19.410328 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90c6cfcf-2e74-4385-9d59-62cf564ffcc7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:19.410755 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90c6cfcf-2e74-4385-9d59-62cf564ffcc7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:19.411459 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90c6cfcf-2e74-4385-9d59-62cf564ffcc7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:19.411903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90c6cfcf-2e74-4385-9d59-62cf564ffcc7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:19.412319 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-90c6cfcf-2e74-4385-9d59-62cf564ffcc7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:19.554342 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-90c6cfcf-2e74-4385-9d59-62cf564ffcc7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:19.563670 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-90c6cfcf-2e74-4385-9d59-62cf564ffcc7 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1757 microversion: 2.1 time: 0.165231 Oct 17 04:41:19.564252 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 485/958] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:19 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:20.587282 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f74d0329-fdbf-4fd0-999f-84c20a65c109 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:20.587829 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f74d0329-fdbf-4fd0-999f-84c20a65c109 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:20.594816 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f74d0329-fdbf-4fd0-999f-84c20a65c109 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:20.595294 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f74d0329-fdbf-4fd0-999f-84c20a65c109 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:20.595730 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f74d0329-fdbf-4fd0-999f-84c20a65c109 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:20.596417 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f74d0329-fdbf-4fd0-999f-84c20a65c109 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:20.596869 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f74d0329-fdbf-4fd0-999f-84c20a65c109 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:20.597321 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f74d0329-fdbf-4fd0-999f-84c20a65c109 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:20.740162 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f74d0329-fdbf-4fd0-999f-84c20a65c109 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:20.748583 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f74d0329-fdbf-4fd0-999f-84c20a65c109 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1757 microversion: 2.1 time: 0.165340 Oct 17 04:41:20.749175 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 474/959] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:20 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:21.771811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-f7cda85f-10b8-4d43-902c-e1baede19941 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:21.772423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-f7cda85f-10b8-4d43-902c-e1baede19941 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:21.779440 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7cda85f-10b8-4d43-902c-e1baede19941 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:21.779934 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7cda85f-10b8-4d43-902c-e1baede19941 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:21.780349 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7cda85f-10b8-4d43-902c-e1baede19941 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:21.781047 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7cda85f-10b8-4d43-902c-e1baede19941 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:21.781522 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7cda85f-10b8-4d43-902c-e1baede19941 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:21.781942 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-f7cda85f-10b8-4d43-902c-e1baede19941 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:21.924064 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-f7cda85f-10b8-4d43-902c-e1baede19941 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:21.933110 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-f7cda85f-10b8-4d43-902c-e1baede19941 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1757 microversion: 2.1 time: 0.165102 Oct 17 04:41:21.933679 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 486/960] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:21 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:22.957500 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8e089b42-cc49-4150-8ce3-0e543ee40b00 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:22.958110 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8e089b42-cc49-4150-8ce3-0e543ee40b00 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:22.964642 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e089b42-cc49-4150-8ce3-0e543ee40b00 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:22.965145 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e089b42-cc49-4150-8ce3-0e543ee40b00 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:22.965577 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e089b42-cc49-4150-8ce3-0e543ee40b00 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:22.966258 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e089b42-cc49-4150-8ce3-0e543ee40b00 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:22.966705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e089b42-cc49-4150-8ce3-0e543ee40b00 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:22.967125 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8e089b42-cc49-4150-8ce3-0e543ee40b00 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:23.105958 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-8e089b42-cc49-4150-8ce3-0e543ee40b00 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:23.114034 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8e089b42-cc49-4150-8ce3-0e543ee40b00 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1757 microversion: 2.1 time: 0.160363 Oct 17 04:41:23.114634 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 475/961] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:22 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:24.137907 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8bd72d3e-8c95-46da-9d07-96810d368fcf tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:24.138526 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8bd72d3e-8c95-46da-9d07-96810d368fcf tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:24.144980 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bd72d3e-8c95-46da-9d07-96810d368fcf tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:24.145492 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bd72d3e-8c95-46da-9d07-96810d368fcf tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:24.145960 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bd72d3e-8c95-46da-9d07-96810d368fcf tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:24.146654 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bd72d3e-8c95-46da-9d07-96810d368fcf tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:24.147111 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bd72d3e-8c95-46da-9d07-96810d368fcf tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:24.147565 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8bd72d3e-8c95-46da-9d07-96810d368fcf tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:24.289177 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-8bd72d3e-8c95-46da-9d07-96810d368fcf tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:24.297736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8bd72d3e-8c95-46da-9d07-96810d368fcf tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1757 microversion: 2.1 time: 0.164217 Oct 17 04:41:24.298307 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 487/962] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:24 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:25.320617 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-b60c7189-555c-47b9-9650-c0040280e70c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:25.321294 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-b60c7189-555c-47b9-9650-c0040280e70c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:25.328017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b60c7189-555c-47b9-9650-c0040280e70c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:25.328497 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b60c7189-555c-47b9-9650-c0040280e70c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:25.328929 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b60c7189-555c-47b9-9650-c0040280e70c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:25.329709 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b60c7189-555c-47b9-9650-c0040280e70c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:25.330162 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b60c7189-555c-47b9-9650-c0040280e70c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:25.330586 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-b60c7189-555c-47b9-9650-c0040280e70c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:25.475781 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-b60c7189-555c-47b9-9650-c0040280e70c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:25.485207 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-b60c7189-555c-47b9-9650-c0040280e70c tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1757 microversion: 2.1 time: 0.168380 Oct 17 04:41:25.485775 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 476/963] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:25 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:26.509455 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-5a596f57-e03f-4932-a31d-8d8a3c8e0aab tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:26.510501 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-5a596f57-e03f-4932-a31d-8d8a3c8e0aab tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:26.517035 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a596f57-e03f-4932-a31d-8d8a3c8e0aab tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:26.517545 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a596f57-e03f-4932-a31d-8d8a3c8e0aab tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:26.517979 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a596f57-e03f-4932-a31d-8d8a3c8e0aab tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:26.518672 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a596f57-e03f-4932-a31d-8d8a3c8e0aab tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:26.519131 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a596f57-e03f-4932-a31d-8d8a3c8e0aab tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:26.519557 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-5a596f57-e03f-4932-a31d-8d8a3c8e0aab tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:26.663694 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-5a596f57-e03f-4932-a31d-8d8a3c8e0aab tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:26.672029 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-5a596f57-e03f-4932-a31d-8d8a3c8e0aab tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1757 microversion: 2.1 time: 0.166622 Oct 17 04:41:26.672603 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 488/964] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:26 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:27.695480 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ae668326-3f19-4aa7-93b4-2624cbdb7f13 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:27.696091 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ae668326-3f19-4aa7-93b4-2624cbdb7f13 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:27.703398 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae668326-3f19-4aa7-93b4-2624cbdb7f13 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:27.703874 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae668326-3f19-4aa7-93b4-2624cbdb7f13 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:27.704307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae668326-3f19-4aa7-93b4-2624cbdb7f13 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:27.704986 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae668326-3f19-4aa7-93b4-2624cbdb7f13 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:27.705463 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae668326-3f19-4aa7-93b4-2624cbdb7f13 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:27.705882 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ae668326-3f19-4aa7-93b4-2624cbdb7f13 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:27.848452 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-ae668326-3f19-4aa7-93b4-2624cbdb7f13 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:27.857204 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ae668326-3f19-4aa7-93b4-2624cbdb7f13 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1760 microversion: 2.1 time: 0.165565 Oct 17 04:41:27.857767 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 477/965] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:27 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1760 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:28.979472 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-64570bc8-b8b7-4e04-bb15-da5ee05d3d17 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:28.980390 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-64570bc8-b8b7-4e04-bb15-da5ee05d3d17 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:28.986249 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64570bc8-b8b7-4e04-bb15-da5ee05d3d17 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:28.986728 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64570bc8-b8b7-4e04-bb15-da5ee05d3d17 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:28.987163 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64570bc8-b8b7-4e04-bb15-da5ee05d3d17 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:28.987847 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64570bc8-b8b7-4e04-bb15-da5ee05d3d17 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:28.988308 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64570bc8-b8b7-4e04-bb15-da5ee05d3d17 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:28.988725 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-64570bc8-b8b7-4e04-bb15-da5ee05d3d17 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:29.013693 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-64570bc8-b8b7-4e04-bb15-da5ee05d3d17 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:41:29.087562 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-64570bc8-b8b7-4e04-bb15-da5ee05d3d17 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 204 len: 0 microversion: 2.1 time: 0.112434 Oct 17 04:41:29.088691 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 489/966] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:41:28 2022] DELETE /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:41:29.097876 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-8df86e5a-1354-49fd-84f5-0fd1608ada49 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:29.098500 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-8df86e5a-1354-49fd-84f5-0fd1608ada49 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:29.105525 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8df86e5a-1354-49fd-84f5-0fd1608ada49 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:29.106006 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8df86e5a-1354-49fd-84f5-0fd1608ada49 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:29.106439 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8df86e5a-1354-49fd-84f5-0fd1608ada49 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:29.107127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8df86e5a-1354-49fd-84f5-0fd1608ada49 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:29.107581 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8df86e5a-1354-49fd-84f5-0fd1608ada49 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:29.108003 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-8df86e5a-1354-49fd-84f5-0fd1608ada49 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:29.242445 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-8df86e5a-1354-49fd-84f5-0fd1608ada49 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:29.250178 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-8df86e5a-1354-49fd-84f5-0fd1608ada49 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1577 microversion: 2.1 time: 0.156410 Oct 17 04:41:29.250758 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 478/967] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:29 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:30.274472 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cbfe5e1d-c414-464a-9cb2-144e9ebf935f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:30.275160 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cbfe5e1d-c414-464a-9cb2-144e9ebf935f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:30.282116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbfe5e1d-c414-464a-9cb2-144e9ebf935f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:30.282592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbfe5e1d-c414-464a-9cb2-144e9ebf935f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:30.283020 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbfe5e1d-c414-464a-9cb2-144e9ebf935f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:30.283696 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbfe5e1d-c414-464a-9cb2-144e9ebf935f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:30.284141 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbfe5e1d-c414-464a-9cb2-144e9ebf935f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:30.284580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cbfe5e1d-c414-464a-9cb2-144e9ebf935f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:30.412863 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-cbfe5e1d-c414-464a-9cb2-144e9ebf935f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:30.420697 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cbfe5e1d-c414-464a-9cb2-144e9ebf935f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1577 microversion: 2.1 time: 0.150411 Oct 17 04:41:30.421354 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 490/968] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:30 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:31.443805 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-f37c14f7-f9bf-4134-82d9-50f8c54a18b5 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:31.444527 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-f37c14f7-f9bf-4134-82d9-50f8c54a18b5 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:31.451702 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f37c14f7-f9bf-4134-82d9-50f8c54a18b5 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:31.452263 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f37c14f7-f9bf-4134-82d9-50f8c54a18b5 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:31.452961 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f37c14f7-f9bf-4134-82d9-50f8c54a18b5 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:31.453684 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f37c14f7-f9bf-4134-82d9-50f8c54a18b5 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:31.454138 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f37c14f7-f9bf-4134-82d9-50f8c54a18b5 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:31.454561 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-f37c14f7-f9bf-4134-82d9-50f8c54a18b5 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:31.517756 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-f37c14f7-f9bf-4134-82d9-50f8c54a18b5 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:31.525499 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-f37c14f7-f9bf-4134-82d9-50f8c54a18b5 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 200 len: 1509 microversion: 2.1 time: 0.085549 Oct 17 04:41:31.526085 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 479/969] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:31 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 1509 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:31.629594 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-0ee293ca-032a-43c9-a277-81d4eb8fd4b8 req-c13cb9d2-b5a4-4a5d-b491-701668cfe192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed045a1c-3978-4818-8ea0-9ee3711acd79", "name": "network-vif-deleted", "tag": "f723b755-7765-47ee-b1b3-a93d16d5f472"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:41:31.641399 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0ee293ca-032a-43c9-a277-81d4eb8fd4b8 req-c13cb9d2-b5a4-4a5d-b491-701668cfe192 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:31.641968 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0ee293ca-032a-43c9-a277-81d4eb8fd4b8 req-c13cb9d2-b5a4-4a5d-b491-701668cfe192 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:31.642667 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0ee293ca-032a-43c9-a277-81d4eb8fd4b8 req-c13cb9d2-b5a4-4a5d-b491-701668cfe192 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:31.654809 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-0ee293ca-032a-43c9-a277-81d4eb8fd4b8 req-c13cb9d2-b5a4-4a5d-b491-701668cfe192 service nova] Creating event network-vif-deleted:f723b755-7765-47ee-b1b3-a93d16d5f472 for instance ed045a1c-3978-4818-8ea0-9ee3711acd79 on hv-cinder-86155 Oct 17 04:41:31.659811 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-0ee293ca-032a-43c9-a277-81d4eb8fd4b8 req-c13cb9d2-b5a4-4a5d-b491-701668cfe192 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033987 Oct 17 04:41:31.660557 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 491/970] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:41:32.549363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1772f75e-6c6c-495a-991c-4b4ef1590488 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:32.550288 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1772f75e-6c6c-495a-991c-4b4ef1590488 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:32.556534 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1772f75e-6c6c-495a-991c-4b4ef1590488 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:32.557772 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1772f75e-6c6c-495a-991c-4b4ef1590488 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:32.558316 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1772f75e-6c6c-495a-991c-4b4ef1590488 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:32.559135 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1772f75e-6c6c-495a-991c-4b4ef1590488 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:32.559653 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1772f75e-6c6c-495a-991c-4b4ef1590488 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:32.560243 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1772f75e-6c6c-495a-991c-4b4ef1590488 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:32.576632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-1772f75e-6c6c-495a-991c-4b4ef1590488 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] HTTP exception thrown: Instance ed045a1c-3978-4818-8ea0-9ee3711acd79 could not be found. Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1772f75e-6c6c-495a-991c-4b4ef1590488 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Request method failure captured: Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 HTTP/1.1 Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNxQz16mJalbzFqHX_tT1cAI9sWZFCod_CQ6WEeQjuarvXtUiew1yAjv1QzVt6gRIH_C7unAVyrlNibPYI_D44--M5yzc1-l5nC1G4npD0HO1t3mPNFEwg_Rnf8ijzyXKQnGNm9wrHjbbLeU7_Ql48XVOuJPOn1FbZcvAU6upG5Zxzg Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: 84d236da3b7b46f4ab13a096d7d80298 Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-TestVolumeBootPattern-593287949 Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:41:32.578628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:41:32.580396 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:41:32.580396 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-TestVolumeBootPattern-593287949 Oct 17 04:41:32.580396 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: 84d236da3b7b46f4ab13a096d7d80298 Oct 17 04:41:32.580396 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestVolumeBootPattern-593287949 Oct 17 04:41:32.580396 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-TestVolumeBootPattern-593287949-project Oct 17 04:41:32.580396 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:41:32.580396 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:41:32.580396 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: 2ed9c2a1827b4fc5a916092b30bdec15 Oct 17 04:41:32.580396 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-TestVolumeBootPattern-593287949-project Oct 17 04:41:32.580396 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:41:32.580396 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance ed045a1c-3978-4818-8ea0-9ee3711acd79 could not be found. Oct 17 04:41:32.580396 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': 'ed045a1c-3978-4818-8ea0-9ee3711acd79'} Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed045a1c-3978-4818-8ea0-9ee3711acd79 could not be found. Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:41:32.581363 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:41:32.582782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:41:32.582782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:41:32.582782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:41:32.582782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:41:32.582782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:41:32.582782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:41:32.582782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:41:32.582782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed045a1c-3978-4818-8ea0-9ee3711acd79 could not be found. Oct 17 04:41:32.582782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:41:32.582782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:41:32.582782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:41:32.582782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:41:32.582782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:41:32.582782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:41:32.582782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:41:32.582782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:41:32.582782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed045a1c-3978-4818-8ea0-9ee3711acd79 could not be found. Oct 17 04:41:32.582782 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:41:32.584010 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1772f75e-6c6c-495a-991c-4b4ef1590488 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Returning 404 to user: Instance ed045a1c-3978-4818-8ea0-9ee3711acd79 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:41:32.584010 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1772f75e-6c6c-495a-991c-4b4ef1590488 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 404 len: 111 microversion: 2.1 time: 0.034632 Oct 17 04:41:32.589234 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 480/971] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:32 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:41:32.692545 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1987951575", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-118990177", "security_groups": [{"name": "tempest-secgroup-smoke-1961840361"}], "block_device_mapping_v2": [{"uuid": "c7c24a4f-69f3-43bd-b82b-d703150d139d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7b10358-ab79-44d7-a22b-ddfa538fb104"}]}} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:41:32.806532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.network.neutron [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] validate_networks() for [('e7b10358-ab79-44d7-a22b-ddfa538fb104', None, None, None, None, None)] {{(pid=119127) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:41:33.227623 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Flavor limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:41:33.228046 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Image limits 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:41:33.228522 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Flavor pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:41:33.229092 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Image pref 0:0:0 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:41:33.229520 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.virt.hardware [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:41:33.238306 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:33.238791 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:33.239224 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:33.239952 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:33.240410 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:33.240835 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:33.257339 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Getting quotas for project 84d236da3b7b46f4ab13a096d7d80298. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:41:33.261821 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.quota [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Getting quotas for user 2ed9c2a1827b4fc5a916092b30bdec15 and project 84d236da3b7b46f4ab13a096d7d80298. Resources: {'ram', 'cores', 'instances'} {{(pid=119127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:41:33.320263 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Going to run 1 instances... {{(pid=119127) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:41:33.323041 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c7c24a4f-69f3-43bd-b82b-d703150d139d',volume_size=None,volume_type=None)] {{(pid=119127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:41:33.446646 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [33596454-c5ae-43ab-ad78-2f2f2df4d044] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 04:41:34.454295 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [33596454-c5ae-43ab-ad78-2f2f2df4d044] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 43076. Oct 17 04:41:34.458116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-cf61525d-c4b8-4665-b460-2c905ece39fa tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.770758 Oct 17 04:41:34.458798 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 492/972] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:41:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 1772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 04:41:34.470298 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1e823974-abaa-4256-916b-7dec7bf01a08 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:34.470907 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1e823974-abaa-4256-916b-7dec7bf01a08 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:34.524467 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-1e823974-abaa-4256-916b-7dec7bf01a08 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:34.532766 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1e823974-abaa-4256-916b-7dec7bf01a08 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 200 len: 1094 microversion: 2.1 time: 0.066222 Oct 17 04:41:34.533392 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 481/973] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:34 2022] GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:35.555794 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-0bddd896-c18f-4fb7-92c9-5ff2393b41b1 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:35.556415 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-0bddd896-c18f-4fb7-92c9-5ff2393b41b1 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:35.563781 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bddd896-c18f-4fb7-92c9-5ff2393b41b1 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:35.564497 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bddd896-c18f-4fb7-92c9-5ff2393b41b1 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:35.565349 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bddd896-c18f-4fb7-92c9-5ff2393b41b1 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:35.566743 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bddd896-c18f-4fb7-92c9-5ff2393b41b1 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:35.567215 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bddd896-c18f-4fb7-92c9-5ff2393b41b1 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:35.567726 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-0bddd896-c18f-4fb7-92c9-5ff2393b41b1 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:35.636552 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-0bddd896-c18f-4fb7-92c9-5ff2393b41b1 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:35.643986 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-0bddd896-c18f-4fb7-92c9-5ff2393b41b1 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 200 len: 1210 microversion: 2.1 time: 0.092183 Oct 17 04:41:35.657136 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 493/974] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:35 2022] GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:36.669920 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-eba55115-6067-4c46-befe-59af4d7119af tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:36.670965 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-eba55115-6067-4c46-befe-59af4d7119af tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:36.679461 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eba55115-6067-4c46-befe-59af4d7119af tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:36.680201 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eba55115-6067-4c46-befe-59af4d7119af tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:36.680835 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eba55115-6067-4c46-befe-59af4d7119af tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:36.682232 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eba55115-6067-4c46-befe-59af4d7119af tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:36.682633 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eba55115-6067-4c46-befe-59af4d7119af tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:36.683258 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-eba55115-6067-4c46-befe-59af4d7119af tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:36.817984 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-eba55115-6067-4c46-befe-59af4d7119af tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:36.829051 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-eba55115-6067-4c46-befe-59af4d7119af tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 200 len: 1266 microversion: 2.1 time: 0.164860 Oct 17 04:41:36.845125 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 482/975] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:36 2022] GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:36.854377 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-21a50c1d-bd50-4d4a-9302-c2e5b584d95c req-5ebdd87e-ebb6-44f7-a608-035f6d099fbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ce3a7c3-014e-41c8-a901-fa08552d42ec", "tag": "7e8c740c-1878-4832-8274-c7a791c5836b"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:41:36.865331 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-21a50c1d-bd50-4d4a-9302-c2e5b584d95c req-5ebdd87e-ebb6-44f7-a608-035f6d099fbd service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:36.865810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-21a50c1d-bd50-4d4a-9302-c2e5b584d95c req-5ebdd87e-ebb6-44f7-a608-035f6d099fbd service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:36.866234 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-21a50c1d-bd50-4d4a-9302-c2e5b584d95c req-5ebdd87e-ebb6-44f7-a608-035f6d099fbd service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:36.878540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-21a50c1d-bd50-4d4a-9302-c2e5b584d95c req-5ebdd87e-ebb6-44f7-a608-035f6d099fbd service nova] Creating event network-changed:7e8c740c-1878-4832-8274-c7a791c5836b for instance 2ce3a7c3-014e-41c8-a901-fa08552d42ec on hv-cinder-86155 Oct 17 04:41:36.883617 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-21a50c1d-bd50-4d4a-9302-c2e5b584d95c req-5ebdd87e-ebb6-44f7-a608-035f6d099fbd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032882 Oct 17 04:41:36.884212 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 494/976] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:41:37.856444 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-67a29c16-805b-4a09-acf8-5c1e88f9c34d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:37.857395 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-67a29c16-805b-4a09-acf8-5c1e88f9c34d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:37.864880 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67a29c16-805b-4a09-acf8-5c1e88f9c34d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:37.865625 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67a29c16-805b-4a09-acf8-5c1e88f9c34d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:37.866247 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67a29c16-805b-4a09-acf8-5c1e88f9c34d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:37.867274 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67a29c16-805b-4a09-acf8-5c1e88f9c34d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:37.867969 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67a29c16-805b-4a09-acf8-5c1e88f9c34d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:37.868575 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-67a29c16-805b-4a09-acf8-5c1e88f9c34d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:38.002911 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-67a29c16-805b-4a09-acf8-5c1e88f9c34d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:38.012638 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-67a29c16-805b-4a09-acf8-5c1e88f9c34d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 200 len: 1266 microversion: 2.1 time: 0.161941 Oct 17 04:41:38.013387 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 483/977] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:37 2022] GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:39.036537 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a21c7c5a-23c2-4f71-a7e8-acfae00f95c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:39.037250 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a21c7c5a-23c2-4f71-a7e8-acfae00f95c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:39.044925 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a21c7c5a-23c2-4f71-a7e8-acfae00f95c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:39.045436 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a21c7c5a-23c2-4f71-a7e8-acfae00f95c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:39.045868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a21c7c5a-23c2-4f71-a7e8-acfae00f95c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:39.046546 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a21c7c5a-23c2-4f71-a7e8-acfae00f95c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:39.047022 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a21c7c5a-23c2-4f71-a7e8-acfae00f95c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:39.047440 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a21c7c5a-23c2-4f71-a7e8-acfae00f95c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:39.178596 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a21c7c5a-23c2-4f71-a7e8-acfae00f95c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:39.187016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a21c7c5a-23c2-4f71-a7e8-acfae00f95c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 200 len: 1266 microversion: 2.1 time: 0.154662 Oct 17 04:41:39.187571 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 495/978] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:39 2022] GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:40.209796 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-451a05ec-e425-4b7e-88a5-70ba83620d0e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:40.210416 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-451a05ec-e425-4b7e-88a5-70ba83620d0e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:40.217285 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-451a05ec-e425-4b7e-88a5-70ba83620d0e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:40.217775 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-451a05ec-e425-4b7e-88a5-70ba83620d0e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:40.218215 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-451a05ec-e425-4b7e-88a5-70ba83620d0e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:40.218906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-451a05ec-e425-4b7e-88a5-70ba83620d0e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:40.219407 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-451a05ec-e425-4b7e-88a5-70ba83620d0e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:40.219836 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-451a05ec-e425-4b7e-88a5-70ba83620d0e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:40.353328 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-451a05ec-e425-4b7e-88a5-70ba83620d0e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:40.361329 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-451a05ec-e425-4b7e-88a5-70ba83620d0e tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 200 len: 1266 microversion: 2.1 time: 0.155310 Oct 17 04:41:40.361906 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 484/979] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:40 2022] GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:41.385042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e5a484c7-e9dc-4397-bf21-a555491a94f4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:41.386047 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e5a484c7-e9dc-4397-bf21-a555491a94f4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:41.388420 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:41:41.393446 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5a484c7-e9dc-4397-bf21-a555491a94f4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:41.393923 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5a484c7-e9dc-4397-bf21-a555491a94f4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:41.394354 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5a484c7-e9dc-4397-bf21-a555491a94f4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:41.395037 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5a484c7-e9dc-4397-bf21-a555491a94f4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:41.395483 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5a484c7-e9dc-4397-bf21-a555491a94f4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:41.395901 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e5a484c7-e9dc-4397-bf21-a555491a94f4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:41.399071 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:41:41.528649 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e5a484c7-e9dc-4397-bf21-a555491a94f4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:41.536317 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e5a484c7-e9dc-4397-bf21-a555491a94f4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 200 len: 1266 microversion: 2.1 time: 0.155695 Oct 17 04:41:41.536887 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 496/980] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:41 2022] GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:42.558675 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9702561d-6ec2-4179-a667-4483c1152584 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:42.559236 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9702561d-6ec2-4179-a667-4483c1152584 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:42.561257 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=33 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:41:42.566954 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9702561d-6ec2-4179-a667-4483c1152584 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:42.567435 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9702561d-6ec2-4179-a667-4483c1152584 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:42.567868 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9702561d-6ec2-4179-a667-4483c1152584 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:42.568602 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9702561d-6ec2-4179-a667-4483c1152584 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:42.569108 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9702561d-6ec2-4179-a667-4483c1152584 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:42.569532 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9702561d-6ec2-4179-a667-4483c1152584 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:42.573785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=81 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:41:42.699269 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-9702561d-6ec2-4179-a667-4483c1152584 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:42.707265 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9702561d-6ec2-4179-a667-4483c1152584 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 200 len: 1266 microversion: 2.1 time: 0.152826 Oct 17 04:41:42.707837 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 485/981] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:42 2022] GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:43.729881 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-514ff056-2408-47f6-9b0a-9775aa0b0e8f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:43.730437 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-514ff056-2408-47f6-9b0a-9775aa0b0e8f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:43.733311 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:41:43.733951 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=6 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:41:43.739770 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-514ff056-2408-47f6-9b0a-9775aa0b0e8f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:43.740252 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-514ff056-2408-47f6-9b0a-9775aa0b0e8f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:43.740868 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-514ff056-2408-47f6-9b0a-9775aa0b0e8f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:43.741601 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-514ff056-2408-47f6-9b0a-9775aa0b0e8f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:43.742052 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-514ff056-2408-47f6-9b0a-9775aa0b0e8f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:43.742479 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-514ff056-2408-47f6-9b0a-9775aa0b0e8f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:43.871833 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-514ff056-2408-47f6-9b0a-9775aa0b0e8f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:43.879481 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-514ff056-2408-47f6-9b0a-9775aa0b0e8f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 200 len: 1266 microversion: 2.1 time: 0.153579 Oct 17 04:41:43.880050 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 497/982] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:43 2022] GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:44.903076 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3ffafd36-25d6-48ed-8b4a-811676ff1055 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:44.903692 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3ffafd36-25d6-48ed-8b4a-811676ff1055 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:44.906036 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:41:44.911455 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ffafd36-25d6-48ed-8b4a-811676ff1055 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:44.911934 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ffafd36-25d6-48ed-8b4a-811676ff1055 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:44.912366 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ffafd36-25d6-48ed-8b4a-811676ff1055 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:44.913091 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ffafd36-25d6-48ed-8b4a-811676ff1055 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:44.913553 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ffafd36-25d6-48ed-8b4a-811676ff1055 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:44.913974 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3ffafd36-25d6-48ed-8b4a-811676ff1055 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:45.041786 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3ffafd36-25d6-48ed-8b4a-811676ff1055 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:45.051229 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3ffafd36-25d6-48ed-8b4a-811676ff1055 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 200 len: 1266 microversion: 2.1 time: 0.151938 Oct 17 04:41:45.051812 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 486/983] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:44 2022] GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:46.074689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-8432c3fd-9b76-485e-9ce8-cade62534852 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:46.075310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-8432c3fd-9b76-485e-9ce8-cade62534852 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:46.082532 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8432c3fd-9b76-485e-9ce8-cade62534852 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:46.083018 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8432c3fd-9b76-485e-9ce8-cade62534852 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:46.083456 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8432c3fd-9b76-485e-9ce8-cade62534852 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:46.084149 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8432c3fd-9b76-485e-9ce8-cade62534852 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:46.084604 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8432c3fd-9b76-485e-9ce8-cade62534852 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:46.085036 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-8432c3fd-9b76-485e-9ce8-cade62534852 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:46.216915 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-8432c3fd-9b76-485e-9ce8-cade62534852 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:46.224669 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-8432c3fd-9b76-485e-9ce8-cade62534852 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 200 len: 1266 microversion: 2.1 time: 0.153853 Oct 17 04:41:46.225261 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 498/984] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:46 2022] GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:47.248625 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-a43b756b-cb67-4434-865d-c58592d105cb tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:47.249394 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-a43b756b-cb67-4434-865d-c58592d105cb tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:47.255767 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a43b756b-cb67-4434-865d-c58592d105cb tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:47.256544 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a43b756b-cb67-4434-865d-c58592d105cb tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:47.256977 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a43b756b-cb67-4434-865d-c58592d105cb tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:47.257729 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a43b756b-cb67-4434-865d-c58592d105cb tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:47.258164 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a43b756b-cb67-4434-865d-c58592d105cb tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:47.258582 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-a43b756b-cb67-4434-865d-c58592d105cb tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:47.284473 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-5a941fca-a8d4-41c3-be35-a8989f8baaaa req-77683407-7375-4cee-a1e8-ff153b9392f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce3a7c3-014e-41c8-a901-fa08552d42ec", "name": "network-vif-plugged", "status": "completed", "tag": "7e8c740c-1878-4832-8274-c7a791c5836b"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:41:47.296044 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5a941fca-a8d4-41c3-be35-a8989f8baaaa req-77683407-7375-4cee-a1e8-ff153b9392f9 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:47.296521 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5a941fca-a8d4-41c3-be35-a8989f8baaaa req-77683407-7375-4cee-a1e8-ff153b9392f9 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:47.296944 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-5a941fca-a8d4-41c3-be35-a8989f8baaaa req-77683407-7375-4cee-a1e8-ff153b9392f9 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:47.308850 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-5a941fca-a8d4-41c3-be35-a8989f8baaaa req-77683407-7375-4cee-a1e8-ff153b9392f9 service nova] Creating event network-vif-plugged:7e8c740c-1878-4832-8274-c7a791c5836b for instance 2ce3a7c3-014e-41c8-a901-fa08552d42ec on hv-cinder-86155 Oct 17 04:41:47.315187 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-5a941fca-a8d4-41c3-be35-a8989f8baaaa req-77683407-7375-4cee-a1e8-ff153b9392f9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102330 Oct 17 04:41:47.316215 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 487/985] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:41:47.417802 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-a43b756b-cb67-4434-865d-c58592d105cb tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:47.426237 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-a43b756b-cb67-4434-865d-c58592d105cb tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 200 len: 1266 microversion: 2.1 time: 0.182126 Oct 17 04:41:47.426820 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 499/986] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:47 2022] GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 04:41:48.451450 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-beec1a0f-53f9-4e48-8dcc-b664ad4d19d2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:48.452074 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-beec1a0f-53f9-4e48-8dcc-b664ad4d19d2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:48.458882 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-beec1a0f-53f9-4e48-8dcc-b664ad4d19d2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:48.459359 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-beec1a0f-53f9-4e48-8dcc-b664ad4d19d2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:48.459790 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-beec1a0f-53f9-4e48-8dcc-b664ad4d19d2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:48.460470 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-beec1a0f-53f9-4e48-8dcc-b664ad4d19d2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:48.460917 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-beec1a0f-53f9-4e48-8dcc-b664ad4d19d2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:48.461364 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-beec1a0f-53f9-4e48-8dcc-b664ad4d19d2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:48.596022 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-beec1a0f-53f9-4e48-8dcc-b664ad4d19d2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:48.603661 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-beec1a0f-53f9-4e48-8dcc-b664ad4d19d2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 200 len: 1266 microversion: 2.1 time: 0.156446 Oct 17 04:41:48.604226 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 488/987] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:48 2022] GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:49.628344 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d7cfbad6-63c7-4a7c-8a29-51dc171640c9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:49.628949 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d7cfbad6-63c7-4a7c-8a29-51dc171640c9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:49.635265 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7cfbad6-63c7-4a7c-8a29-51dc171640c9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:49.635744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7cfbad6-63c7-4a7c-8a29-51dc171640c9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:49.636177 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7cfbad6-63c7-4a7c-8a29-51dc171640c9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:49.636852 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7cfbad6-63c7-4a7c-8a29-51dc171640c9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:49.637329 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7cfbad6-63c7-4a7c-8a29-51dc171640c9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:49.637775 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d7cfbad6-63c7-4a7c-8a29-51dc171640c9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:49.767893 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-d7cfbad6-63c7-4a7c-8a29-51dc171640c9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:49.775720 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d7cfbad6-63c7-4a7c-8a29-51dc171640c9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 200 len: 1453 microversion: 2.1 time: 0.151247 Oct 17 04:41:49.776279 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 500/988] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:49 2022] GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:49.799250 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7b295f3b-775b-4c97-a543-5b1018d1dace tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:41:49.799858 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7b295f3b-775b-4c97-a543-5b1018d1dace tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:41:49.806105 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b295f3b-775b-4c97-a543-5b1018d1dace tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:49.806581 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b295f3b-775b-4c97-a543-5b1018d1dace tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:49.807012 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b295f3b-775b-4c97-a543-5b1018d1dace tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:49.807689 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b295f3b-775b-4c97-a543-5b1018d1dace tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:49.808136 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b295f3b-775b-4c97-a543-5b1018d1dace tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:49.808555 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7b295f3b-775b-4c97-a543-5b1018d1dace tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:50.087100 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-7b295f3b-775b-4c97-a543-5b1018d1dace tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:41:50.095264 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7b295f3b-775b-4c97-a543-5b1018d1dace tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 200 len: 1453 microversion: 2.1 time: 0.299778 Oct 17 04:41:50.095823 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 489/989] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:41:49 2022] GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 1453 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:41:51.662294 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-f5dbd673-dae0-490e-9d57-bc8781cbd8b3 req-68b92529-9267-4f22-8c78-dd8a7b8f0be3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ce3a7c3-014e-41c8-a901-fa08552d42ec", "tag": "7e8c740c-1878-4832-8274-c7a791c5836b"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:41:51.673715 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f5dbd673-dae0-490e-9d57-bc8781cbd8b3 req-68b92529-9267-4f22-8c78-dd8a7b8f0be3 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:41:51.674189 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f5dbd673-dae0-490e-9d57-bc8781cbd8b3 req-68b92529-9267-4f22-8c78-dd8a7b8f0be3 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:41:51.674615 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-f5dbd673-dae0-490e-9d57-bc8781cbd8b3 req-68b92529-9267-4f22-8c78-dd8a7b8f0be3 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:41:51.687431 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-f5dbd673-dae0-490e-9d57-bc8781cbd8b3 req-68b92529-9267-4f22-8c78-dd8a7b8f0be3 service nova] Creating event network-changed:7e8c740c-1878-4832-8274-c7a791c5836b for instance 2ce3a7c3-014e-41c8-a901-fa08552d42ec on hv-cinder-86155 Oct 17 04:41:51.692440 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-f5dbd673-dae0-490e-9d57-bc8781cbd8b3 req-68b92529-9267-4f22-8c78-dd8a7b8f0be3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033888 Oct 17 04:41:51.693042 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 501/990] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:42:00.282109 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-4a61c923-2778-4d3a-b2ff-ea965ca8d5bc tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1773030672"}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:42:00.282693 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-4a61c923-2778-4d3a-b2ff-ea965ca8d5bc tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:42:00.285773 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 04:42:00.285921 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Mon Oct 17 04:42:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c/action (ip 10.222.0.40) !!! Oct 17 04:42:00.286989 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=9 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:42:00.287632 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=25 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:42:00.295974 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a61c923-2778-4d3a-b2ff-ea965ca8d5bc tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:00.296464 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a61c923-2778-4d3a-b2ff-ea965ca8d5bc tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:00.296908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a61c923-2778-4d3a-b2ff-ea965ca8d5bc tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:00.297637 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a61c923-2778-4d3a-b2ff-ea965ca8d5bc tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:00.298090 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a61c923-2778-4d3a-b2ff-ea965ca8d5bc tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:00.298517 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-4a61c923-2778-4d3a-b2ff-ea965ca8d5bc tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:00.421941 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.network.security_group_api [None req-4a61c923-2778-4d3a-b2ff-ea965ca8d5bc tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Removing security group 2aedb6d8-1729-4ae3-a30a-dfbac6e19228 from port f0f6ca07-b0d8-4ee0-9614-ddf606753cac Oct 17 04:42:00.724273 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-4a61c923-2778-4d3a-b2ff-ea965ca8d5bc tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "POST /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c/action" status: 202 len: 0 microversion: 2.1 time: 0.446546 Oct 17 04:42:00.728247 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 490/991] 10.222.0.40 () {60 vars in 1278 bytes} [Mon Oct 17 04:42:00 2022] POST /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:42:00.736086 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-3d05fac9-bcaa-4ba9-8139-153b901dd5bc req-86bcb5e6-a1ca-4443-a469-8bb6494da80c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2192d50d-fc32-4eb2-8028-df6b4844be8c", "tag": "f0f6ca07-b0d8-4ee0-9614-ddf606753cac"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:42:00.746735 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3d05fac9-bcaa-4ba9-8139-153b901dd5bc req-86bcb5e6-a1ca-4443-a469-8bb6494da80c service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:00.747934 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3d05fac9-bcaa-4ba9-8139-153b901dd5bc req-86bcb5e6-a1ca-4443-a469-8bb6494da80c service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:00.748579 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-3d05fac9-bcaa-4ba9-8139-153b901dd5bc req-86bcb5e6-a1ca-4443-a469-8bb6494da80c service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:00.765185 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-3d05fac9-bcaa-4ba9-8139-153b901dd5bc req-86bcb5e6-a1ca-4443-a469-8bb6494da80c service nova] Creating event network-changed:f0f6ca07-b0d8-4ee0-9614-ddf606753cac for instance 2192d50d-fc32-4eb2-8028-df6b4844be8c on hv-cinder-86155 Oct 17 04:42:00.770637 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-3d05fac9-bcaa-4ba9-8139-153b901dd5bc req-86bcb5e6-a1ca-4443-a469-8bb6494da80c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041466 Oct 17 04:42:00.771519 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 502/992] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:42:02.017002 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9a31bcd2-d7f6-4f5e-ade0-d86b512a1fa0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:42:02.017542 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9a31bcd2-d7f6-4f5e-ade0-d86b512a1fa0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:42:02.023570 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a31bcd2-d7f6-4f5e-ade0-d86b512a1fa0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:02.024054 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a31bcd2-d7f6-4f5e-ade0-d86b512a1fa0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:02.024488 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a31bcd2-d7f6-4f5e-ade0-d86b512a1fa0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:02.025214 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a31bcd2-d7f6-4f5e-ade0-d86b512a1fa0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:02.025672 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a31bcd2-d7f6-4f5e-ade0-d86b512a1fa0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:02.026095 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9a31bcd2-d7f6-4f5e-ade0-d86b512a1fa0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:02.108595 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-9a31bcd2-d7f6-4f5e-ade0-d86b512a1fa0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lazy-loading 'services' on Instance uuid 2192d50d-fc32-4eb2-8028-df6b4844be8c {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:42:02.181104 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9a31bcd2-d7f6-4f5e-ade0-d86b512a1fa0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c/os-volume_attachments/0cb440a9-3fdb-4c83-b7d8-b0f6f549eefc" status: 202 len: 0 microversion: 2.1 time: 0.169204 Oct 17 04:42:02.182071 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 491/993] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Oct 17 04:42:02 2022] DELETE /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c/os-volume_attachments/0cb440a9-3fdb-4c83-b7d8-b0f6f549eefc => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:42:02.191592 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-28c306a7-def0-4283-99b5-9d87adb39503 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:42:02.193933 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-28c306a7-def0-4283-99b5-9d87adb39503 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:42:02.202054 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28c306a7-def0-4283-99b5-9d87adb39503 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:02.202826 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28c306a7-def0-4283-99b5-9d87adb39503 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:02.203265 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28c306a7-def0-4283-99b5-9d87adb39503 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:02.203984 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28c306a7-def0-4283-99b5-9d87adb39503 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:02.204426 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28c306a7-def0-4283-99b5-9d87adb39503 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:02.204843 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-28c306a7-def0-4283-99b5-9d87adb39503 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:02.235996 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-28c306a7-def0-4283-99b5-9d87adb39503 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049040 Oct 17 04:42:02.240851 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 503/994] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:42:02 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:42:02.786245 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-bc96a937-372a-4972-a2c2-f6769009544c req-f9e3fe5d-d1fd-4f4e-a840-f046d96121aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2192d50d-fc32-4eb2-8028-df6b4844be8c", "tag": "f0f6ca07-b0d8-4ee0-9614-ddf606753cac"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:42:02.796102 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-bc96a937-372a-4972-a2c2-f6769009544c req-f9e3fe5d-d1fd-4f4e-a840-f046d96121aa service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:02.796594 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-bc96a937-372a-4972-a2c2-f6769009544c req-f9e3fe5d-d1fd-4f4e-a840-f046d96121aa service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:02.797035 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-bc96a937-372a-4972-a2c2-f6769009544c req-f9e3fe5d-d1fd-4f4e-a840-f046d96121aa service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:02.808073 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-bc96a937-372a-4972-a2c2-f6769009544c req-f9e3fe5d-d1fd-4f4e-a840-f046d96121aa service nova] Creating event network-changed:f0f6ca07-b0d8-4ee0-9614-ddf606753cac for instance 2192d50d-fc32-4eb2-8028-df6b4844be8c on hv-cinder-86155 Oct 17 04:42:02.813535 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-bc96a937-372a-4972-a2c2-f6769009544c req-f9e3fe5d-d1fd-4f4e-a840-f046d96121aa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031333 Oct 17 04:42:02.814146 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 492/995] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:42:03.249170 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3bfda25f-d24b-4944-be01-ba3b56273a99 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:42:03.251390 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3bfda25f-d24b-4944-be01-ba3b56273a99 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:42:03.257693 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bfda25f-d24b-4944-be01-ba3b56273a99 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:03.258174 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bfda25f-d24b-4944-be01-ba3b56273a99 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:03.258602 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bfda25f-d24b-4944-be01-ba3b56273a99 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:03.259291 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bfda25f-d24b-4944-be01-ba3b56273a99 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:03.259739 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bfda25f-d24b-4944-be01-ba3b56273a99 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:03.260164 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3bfda25f-d24b-4944-be01-ba3b56273a99 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:03.290101 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3bfda25f-d24b-4944-be01-ba3b56273a99 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046005 Oct 17 04:42:03.290662 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 504/996] 10.222.0.40 () {58 vars in 1302 bytes} [Mon Oct 17 04:42:03 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 04:42:03.303217 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-322fce16-fe76-4062-ac83-65867674df56 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:42:03.304612 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-322fce16-fe76-4062-ac83-65867674df56 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:42:03.312534 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-322fce16-fe76-4062-ac83-65867674df56 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:03.313281 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-322fce16-fe76-4062-ac83-65867674df56 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:03.313895 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-322fce16-fe76-4062-ac83-65867674df56 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:03.314858 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-322fce16-fe76-4062-ac83-65867674df56 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:03.315530 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-322fce16-fe76-4062-ac83-65867674df56 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:03.316041 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-322fce16-fe76-4062-ac83-65867674df56 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:03.392785 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-322fce16-fe76-4062-ac83-65867674df56 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] HTTP exception thrown: Instance 2192d50d-fc32-4eb2-8028-df6b4844be8c is not attached to volume 0cb440a9-3fdb-4c83-b7d8-b0f6f549eefc Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-322fce16-fe76-4062-ac83-65867674df56 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Request method failure captured: Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c/os-volume_attachments/0cb440a9-3fdb-4c83-b7d8-b0f6f549eefc HTTP/1.1 Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNyiZmIqHyz0bmrWnPh4mgbu6IJJNCvde8T-yFrNFngsaohJ20aPuiFJf1l5xofk4kvYkDEATCh3i3x_aTwvaicm3mvYqjIz4zQmQVbyiRPFi7GjJ0pv8gEYUvv6ftei_MOxXggxjSsWt64jzNAD81lyS96UGMB0AmTlVYjdBU3HeOk Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: fa613028ef8e48df8eb7178c54926095 Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-TestMinimumBasicScenario-375974286 Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:42:03.395127 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:42:03.396907 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa613028ef8e48df8eb7178c54926095"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa613028ef8e48df8eb7178c54926095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa613028ef8e48df8eb7178c54926095"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa613028ef8e48df8eb7178c54926095"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:42:03.396907 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-TestMinimumBasicScenario-375974286 Oct 17 04:42:03.396907 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: fa613028ef8e48df8eb7178c54926095 Oct 17 04:42:03.396907 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestMinimumBasicScenario-375974286 Oct 17 04:42:03.396907 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-TestMinimumBasicScenario-375974286-project Oct 17 04:42:03.396907 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:42:03.396907 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:42:03.396907 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: c7d3b6f659c3404996aea8de61ad332c Oct 17 04:42:03.396907 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-TestMinimumBasicScenario-375974286-project Oct 17 04:42:03.396907 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:42:03.396907 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance 2192d50d-fc32-4eb2-8028-df6b4844be8c is not attached to volume 0cb440a9-3fdb-4c83-b7d8-b0f6f549eefc Oct 17 04:42:03.397885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'server_id': '2192d50d-fc32-4eb2-8028-df6b4844be8c', 'id': '0cb440a9-3fdb-4c83-b7d8-b0f6f549eefc'} Oct 17 04:42:03.397885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:42:03.397885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:42:03.397885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 04:42:03.397885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 04:42:03.397885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 04:42:03.397885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 04:42:03.397885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 04:42:03.397885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 04:42:03.397885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0cb440a9-3fdb-4c83-b7d8-b0f6f549eefc. Oct 17 04:42:03.397885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:42:03.397885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:42:03.397885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:42:03.397885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:42:03.397885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:42:03.397885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:42:03.397885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:42:03.397885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:42:03.397885 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:42:03.399482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:42:03.399482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 04:42:03.399482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 04:42:03.399482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2192d50d-fc32-4eb2-8028-df6b4844be8c is not attached to volume 0cb440a9-3fdb-4c83-b7d8-b0f6f549eefc Oct 17 04:42:03.399482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:42:03.399482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:42:03.399482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:42:03.399482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:42:03.399482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:42:03.399482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:42:03.399482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:42:03.399482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:42:03.399482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2192d50d-fc32-4eb2-8028-df6b4844be8c is not attached to volume 0cb440a9-3fdb-4c83-b7d8-b0f6f549eefc Oct 17 04:42:03.399482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:42:03.399482 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-322fce16-fe76-4062-ac83-65867674df56 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Returning 404 to user: Instance 2192d50d-fc32-4eb2-8028-df6b4844be8c is not attached to volume 0cb440a9-3fdb-4c83-b7d8-b0f6f549eefc {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:42:03.400711 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-322fce16-fe76-4062-ac83-65867674df56 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c/os-volume_attachments/0cb440a9-3fdb-4c83-b7d8-b0f6f549eefc" status: 404 len: 154 microversion: 2.1 time: 0.098556 Oct 17 04:42:03.400711 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 493/997] 10.222.0.40 () {58 vars in 1416 bytes} [Mon Oct 17 04:42:03 2022] DELETE /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c/os-volume_attachments/0cb440a9-3fdb-4c83-b7d8-b0f6f549eefc => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:42:04.537168 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-4390bc30-8a38-4054-9035-2f987c5b6f18 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:42:04.537684 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4390bc30-8a38-4054-9035-2f987c5b6f18 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:42:04.544015 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4390bc30-8a38-4054-9035-2f987c5b6f18 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:04.544605 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4390bc30-8a38-4054-9035-2f987c5b6f18 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:04.545036 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4390bc30-8a38-4054-9035-2f987c5b6f18 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:04.545747 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4390bc30-8a38-4054-9035-2f987c5b6f18 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:04.546199 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4390bc30-8a38-4054-9035-2f987c5b6f18 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:04.546621 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-4390bc30-8a38-4054-9035-2f987c5b6f18 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:04.570856 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-4390bc30-8a38-4054-9035-2f987c5b6f18 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Going to try to terminate instance {{(pid=119127) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:42:04.643053 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-4390bc30-8a38-4054-9035-2f987c5b6f18 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 204 len: 0 microversion: 2.1 time: 0.109484 Oct 17 04:42:04.643838 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 505/998] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:42:04 2022] DELETE /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:42:04.653037 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-0a86652a-89ad-4c6e-aadb-096daca17eba tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:42:04.653775 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-0a86652a-89ad-4c6e-aadb-096daca17eba tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:42:04.662634 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a86652a-89ad-4c6e-aadb-096daca17eba tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:04.663129 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a86652a-89ad-4c6e-aadb-096daca17eba tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:04.663572 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a86652a-89ad-4c6e-aadb-096daca17eba tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:04.664322 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a86652a-89ad-4c6e-aadb-096daca17eba tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:04.664786 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a86652a-89ad-4c6e-aadb-096daca17eba tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:04.665287 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-0a86652a-89ad-4c6e-aadb-096daca17eba tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:04.795050 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-0a86652a-89ad-4c6e-aadb-096daca17eba tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:42:04.802704 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-0a86652a-89ad-4c6e-aadb-096daca17eba tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1555 microversion: 2.1 time: 0.154558 Oct 17 04:42:04.803265 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 494/999] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:42:04 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:42:05.826559 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-98380e0f-dae6-46eb-9316-b510d875e126 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:42:05.827263 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-98380e0f-dae6-46eb-9316-b510d875e126 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:42:05.833822 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98380e0f-dae6-46eb-9316-b510d875e126 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:05.834301 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98380e0f-dae6-46eb-9316-b510d875e126 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:05.834754 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98380e0f-dae6-46eb-9316-b510d875e126 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:05.835422 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98380e0f-dae6-46eb-9316-b510d875e126 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:05.835873 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98380e0f-dae6-46eb-9316-b510d875e126 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:05.836325 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-98380e0f-dae6-46eb-9316-b510d875e126 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:05.969574 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-98380e0f-dae6-46eb-9316-b510d875e126 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:42:05.977291 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-98380e0f-dae6-46eb-9316-b510d875e126 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1555 microversion: 2.1 time: 0.154977 Oct 17 04:42:05.977863 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 506/1000] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:42:05 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:42:07.000656 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-9c520cd6-9770-42f9-8873-6398aa05ff32 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:42:07.001315 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-9c520cd6-9770-42f9-8873-6398aa05ff32 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:42:07.007669 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c520cd6-9770-42f9-8873-6398aa05ff32 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:07.008149 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c520cd6-9770-42f9-8873-6398aa05ff32 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:07.008601 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c520cd6-9770-42f9-8873-6398aa05ff32 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:07.009308 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c520cd6-9770-42f9-8873-6398aa05ff32 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:07.009757 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c520cd6-9770-42f9-8873-6398aa05ff32 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:07.010176 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-9c520cd6-9770-42f9-8873-6398aa05ff32 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:07.080654 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-9c520cd6-9770-42f9-8873-6398aa05ff32 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7d3b6f659c3404996aea8de61ad332c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa613028ef8e48df8eb7178c54926095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:42:07.088675 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-9c520cd6-9770-42f9-8873-6398aa05ff32 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 200 len: 1513 microversion: 2.1 time: 0.092606 Oct 17 04:42:07.089513 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 495/1001] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:42:06 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 1513 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:42:07.131680 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-0784b2ce-c392-423a-9bcf-0a64feafc64a req-b4f3e0ea-dd48-4237-a2cc-be484229130c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2192d50d-fc32-4eb2-8028-df6b4844be8c", "name": "network-vif-deleted", "tag": "f0f6ca07-b0d8-4ee0-9614-ddf606753cac"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:42:07.143202 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0784b2ce-c392-423a-9bcf-0a64feafc64a req-b4f3e0ea-dd48-4237-a2cc-be484229130c service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:07.143675 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0784b2ce-c392-423a-9bcf-0a64feafc64a req-b4f3e0ea-dd48-4237-a2cc-be484229130c service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:07.144104 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-0784b2ce-c392-423a-9bcf-0a64feafc64a req-b4f3e0ea-dd48-4237-a2cc-be484229130c service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:07.156169 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-0784b2ce-c392-423a-9bcf-0a64feafc64a req-b4f3e0ea-dd48-4237-a2cc-be484229130c service nova] Creating event network-vif-deleted:f0f6ca07-b0d8-4ee0-9614-ddf606753cac for instance 2192d50d-fc32-4eb2-8028-df6b4844be8c on hv-cinder-86155 Oct 17 04:42:07.161063 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-0784b2ce-c392-423a-9bcf-0a64feafc64a req-b4f3e0ea-dd48-4237-a2cc-be484229130c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033115 Oct 17 04:42:07.161679 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 507/1002] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:42:08.112504 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-88e10a9e-ee83-469e-809b-233032ea46a0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:42:08.113130 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-88e10a9e-ee83-469e-809b-233032ea46a0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] [instance: 2192d50d-fc32-4eb2-8028-df6b4844be8c] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:42:08.119736 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88e10a9e-ee83-469e-809b-233032ea46a0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:08.120220 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88e10a9e-ee83-469e-809b-233032ea46a0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:08.120660 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88e10a9e-ee83-469e-809b-233032ea46a0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:08.121385 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88e10a9e-ee83-469e-809b-233032ea46a0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:42:08.121841 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88e10a9e-ee83-469e-809b-233032ea46a0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:42:08.122859 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-88e10a9e-ee83-469e-809b-233032ea46a0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:42:08.136549 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-88e10a9e-ee83-469e-809b-233032ea46a0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] HTTP exception thrown: Instance 2192d50d-fc32-4eb2-8028-df6b4844be8c could not be found. Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-88e10a9e-ee83-469e-809b-233032ea46a0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Request method failure captured: Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c HTTP/1.1 Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNyiZmIqHyz0bmrWnPh4mgbu6IJJNCvde8T-yFrNFngsaohJ20aPuiFJf1l5xofk4kvYkDEATCh3i3x_aTwvaicm3mvYqjIz4zQmQVbyiRPFi7GjJ0pv8gEYUvv6ftei_MOxXggxjSsWt64jzNAD81lyS96UGMB0AmTlVYjdBU3HeOk Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: fa613028ef8e48df8eb7178c54926095 Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-TestMinimumBasicScenario-375974286 Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:42:08.138940 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:42:08.140604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa613028ef8e48df8eb7178c54926095"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fa613028ef8e48df8eb7178c54926095"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fa613028ef8e48df8eb7178c54926095"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fa613028ef8e48df8eb7178c54926095"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:42:08.140604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-TestMinimumBasicScenario-375974286 Oct 17 04:42:08.140604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: fa613028ef8e48df8eb7178c54926095 Oct 17 04:42:08.140604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestMinimumBasicScenario-375974286 Oct 17 04:42:08.140604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-TestMinimumBasicScenario-375974286-project Oct 17 04:42:08.140604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:42:08.140604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:42:08.140604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: c7d3b6f659c3404996aea8de61ad332c Oct 17 04:42:08.140604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-TestMinimumBasicScenario-375974286-project Oct 17 04:42:08.140604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:42:08.140604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance 2192d50d-fc32-4eb2-8028-df6b4844be8c could not be found. Oct 17 04:42:08.140604 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': '2192d50d-fc32-4eb2-8028-df6b4844be8c'} Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2192d50d-fc32-4eb2-8028-df6b4844be8c could not be found. Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:42:08.141556 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:42:08.143119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:42:08.143119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:42:08.143119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:42:08.143119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:42:08.143119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:42:08.143119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:42:08.143119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:42:08.143119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2192d50d-fc32-4eb2-8028-df6b4844be8c could not be found. Oct 17 04:42:08.143119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:42:08.143119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:42:08.143119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:42:08.143119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:42:08.143119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:42:08.143119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:42:08.143119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:42:08.143119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:42:08.143119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2192d50d-fc32-4eb2-8028-df6b4844be8c could not be found. Oct 17 04:42:08.143119 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:42:08.144714 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-88e10a9e-ee83-469e-809b-233032ea46a0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Returning 404 to user: Instance 2192d50d-fc32-4eb2-8028-df6b4844be8c could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:42:08.144714 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-88e10a9e-ee83-469e-809b-233032ea46a0 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c" status: 404 len: 111 microversion: 2.1 time: 0.031662 Oct 17 04:42:08.144714 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 496/1003] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:42:08 2022] GET /compute/v2.1/servers/2192d50d-fc32-4eb2-8028-df6b4844be8c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 04:42:08.150091 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2f6c200e-88b3-4ac6-9b7a-3ed1a3fe2c21 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] Calling method '.version_select at 0x7fc630e638b0>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:42:08.167793 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2f6c200e-88b3-4ac6-9b7a-3ed1a3fe2c21 tempest-TestMinimumBasicScenario-375974286 tempest-TestMinimumBasicScenario-375974286-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1638242677" status: 202 len: 0 microversion: 2.1 time: 0.022438 Oct 17 04:42:08.168337 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 508/1004] 10.222.0.40 () {58 vars in 1272 bytes} [Mon Oct 17 04:42:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1638242677 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 04:43:37.372407 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=14 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:43:37.373160 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:43:37.377466 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-669437208", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-118990177", "security_groups": [{"name": "tempest-secgroup-smoke-1961840361"}], "block_device_mapping_v2": [{"uuid": "0f753de6-c5b7-4612-8b77-8e205ddbf688", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7b10358-ab79-44d7-a22b-ddfa538fb104"}]}} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:43:37.489222 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.network.neutron [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] validate_networks() for [('e7b10358-ab79-44d7-a22b-ddfa538fb104', None, None, None, None, None)] {{(pid=119128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 04:43:37.959284 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Flavor limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 04:43:37.959705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Image limits 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 04:43:37.960175 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Flavor pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 04:43:37.960581 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Image pref 0:0:0 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 04:43:37.960992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.virt.hardware [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 04:43:37.969851 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:37.970324 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:37.970786 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:37.971538 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:37.971989 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:37.972409 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:37.988601 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Getting quotas for project 84d236da3b7b46f4ab13a096d7d80298. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 04:43:37.992529 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.quota [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Getting quotas for user 2ed9c2a1827b4fc5a916092b30bdec15 and project 84d236da3b7b46f4ab13a096d7d80298. Resources: {'ram', 'cores', 'instances'} {{(pid=119128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 04:43:38.049307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Going to run 1 instances... {{(pid=119128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 04:43:38.051428 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f753de6-c5b7-4612-8b77-8e205ddbf688',volume_size=None,volume_type=None)] {{(pid=119128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 04:43:38.177763 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR oslo.messaging._drivers.impl_rabbit [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [6a84c42d-ebf0-418f-bb5e-12eefcda1995] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 04:43:39.186108 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [6a84c42d-ebf0-418f-bb5e-12eefcda1995] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 43330. Oct 17 04:43:39.189910 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-225cd572-305c-4e98-8c0c-7c34eee73e86 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.819439 Oct 17 04:43:39.190558 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 497/1005] 10.222.0.40 () {60 vars in 1147 bytes} [Mon Oct 17 04:43:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 04:43:39.201616 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:43:39.202597 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:43:39.207083 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-19b0e49f-a3a6-4559-9f86-7f889edd0897 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:43:39.207785 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-19b0e49f-a3a6-4559-9f86-7f889edd0897 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:43:39.272602 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-19b0e49f-a3a6-4559-9f86-7f889edd0897 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:43:39.279441 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-19b0e49f-a3a6-4559-9f86-7f889edd0897 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474" status: 200 len: 1093 microversion: 2.1 time: 0.081213 Oct 17 04:43:39.280006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 509/1006] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:43:39 2022] GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 => generated 1093 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:43:40.303422 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-a8a26ff3-0471-41d0-afa3-eb70a83e8809 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:43:40.304061 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-a8a26ff3-0471-41d0-afa3-eb70a83e8809 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:43:40.311832 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8a26ff3-0471-41d0-afa3-eb70a83e8809 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:40.312572 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8a26ff3-0471-41d0-afa3-eb70a83e8809 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:40.313012 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8a26ff3-0471-41d0-afa3-eb70a83e8809 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:40.314008 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8a26ff3-0471-41d0-afa3-eb70a83e8809 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:40.314555 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8a26ff3-0471-41d0-afa3-eb70a83e8809 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:40.315233 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-a8a26ff3-0471-41d0-afa3-eb70a83e8809 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:40.381012 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-a8a26ff3-0471-41d0-afa3-eb70a83e8809 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:43:40.390180 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-a8a26ff3-0471-41d0-afa3-eb70a83e8809 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474" status: 200 len: 1209 microversion: 2.1 time: 0.091764 Oct 17 04:43:40.390746 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 498/1007] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:43:40 2022] GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 => generated 1209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:43:41.413879 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e0703169-a4d9-4645-b4d7-112dd2265fe4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:43:41.414522 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e0703169-a4d9-4645-b4d7-112dd2265fe4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:43:41.422807 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0703169-a4d9-4645-b4d7-112dd2265fe4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:41.423376 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0703169-a4d9-4645-b4d7-112dd2265fe4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:41.423879 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0703169-a4d9-4645-b4d7-112dd2265fe4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:41.424582 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0703169-a4d9-4645-b4d7-112dd2265fe4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:41.425033 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0703169-a4d9-4645-b4d7-112dd2265fe4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:41.425587 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e0703169-a4d9-4645-b4d7-112dd2265fe4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:41.556062 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e0703169-a4d9-4645-b4d7-112dd2265fe4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:43:41.564518 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e0703169-a4d9-4645-b4d7-112dd2265fe4 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474" status: 200 len: 1265 microversion: 2.1 time: 0.154464 Oct 17 04:43:41.565018 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 510/1008] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:43:41 2022] GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:43:42.008819 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [req-33480a3e-4798-43d0-95da-ece2476b0da1 req-f6c61420-a8a0-4e9b-a6f6-dae9a8f45ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6c6596-e633-4406-983b-4074ea319474", "tag": "0525cf26-2cec-4fb2-8c7f-d4f1e0d418cf"}]} {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:43:42.018856 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-33480a3e-4798-43d0-95da-ece2476b0da1 req-f6c61420-a8a0-4e9b-a6f6-dae9a8f45ef7 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:42.019346 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-33480a3e-4798-43d0-95da-ece2476b0da1 req-f6c61420-a8a0-4e9b-a6f6-dae9a8f45ef7 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:42.019786 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [req-33480a3e-4798-43d0-95da-ece2476b0da1 req-f6c61420-a8a0-4e9b-a6f6-dae9a8f45ef7 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:42.031253 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.compute.server_external_events [req-33480a3e-4798-43d0-95da-ece2476b0da1 req-f6c61420-a8a0-4e9b-a6f6-dae9a8f45ef7 service nova] Creating event network-changed:0525cf26-2cec-4fb2-8c7f-d4f1e0d418cf for instance 5c6c6596-e633-4406-983b-4074ea319474 on hv-cinder-86155 Oct 17 04:43:42.036271 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [req-33480a3e-4798-43d0-95da-ece2476b0da1 req-f6c61420-a8a0-4e9b-a6f6-dae9a8f45ef7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163502 Oct 17 04:43:42.036983 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 499/1009] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:43:42.587853 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-d1bb6f29-1096-47fd-9ae3-a994c683f915 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:43:42.588547 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-d1bb6f29-1096-47fd-9ae3-a994c683f915 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:43:42.595903 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1bb6f29-1096-47fd-9ae3-a994c683f915 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:42.596460 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1bb6f29-1096-47fd-9ae3-a994c683f915 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:42.596900 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1bb6f29-1096-47fd-9ae3-a994c683f915 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:42.597613 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1bb6f29-1096-47fd-9ae3-a994c683f915 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:42.598063 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1bb6f29-1096-47fd-9ae3-a994c683f915 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:42.598482 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-d1bb6f29-1096-47fd-9ae3-a994c683f915 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:42.733580 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-d1bb6f29-1096-47fd-9ae3-a994c683f915 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:43:42.741451 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-d1bb6f29-1096-47fd-9ae3-a994c683f915 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474" status: 200 len: 1265 microversion: 2.1 time: 0.157545 Oct 17 04:43:42.742031 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 511/1010] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:43:42 2022] GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:43:43.765017 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-e5f3b993-7664-422c-9421-4e5b9aedfef8 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:43:43.765764 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-e5f3b993-7664-422c-9421-4e5b9aedfef8 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:43:43.771872 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e5f3b993-7664-422c-9421-4e5b9aedfef8 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:43.772351 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e5f3b993-7664-422c-9421-4e5b9aedfef8 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:43.772784 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e5f3b993-7664-422c-9421-4e5b9aedfef8 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:43.773499 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e5f3b993-7664-422c-9421-4e5b9aedfef8 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:43.773953 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e5f3b993-7664-422c-9421-4e5b9aedfef8 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:43.774370 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-e5f3b993-7664-422c-9421-4e5b9aedfef8 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:43.904729 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-e5f3b993-7664-422c-9421-4e5b9aedfef8 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:43:43.912468 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-e5f3b993-7664-422c-9421-4e5b9aedfef8 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474" status: 200 len: 1265 microversion: 2.1 time: 0.152584 Oct 17 04:43:43.913025 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 500/1011] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:43:43 2022] GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:43:44.936649 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-957862a6-bd68-4b7e-b63e-1e02125ecacc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:43:44.937285 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-957862a6-bd68-4b7e-b63e-1e02125ecacc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:43:44.944926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-957862a6-bd68-4b7e-b63e-1e02125ecacc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:44.945447 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-957862a6-bd68-4b7e-b63e-1e02125ecacc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:44.945886 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-957862a6-bd68-4b7e-b63e-1e02125ecacc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:44.946582 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-957862a6-bd68-4b7e-b63e-1e02125ecacc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:44.947037 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-957862a6-bd68-4b7e-b63e-1e02125ecacc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:44.947463 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-957862a6-bd68-4b7e-b63e-1e02125ecacc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:45.073675 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-957862a6-bd68-4b7e-b63e-1e02125ecacc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:43:45.081740 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-957862a6-bd68-4b7e-b63e-1e02125ecacc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474" status: 200 len: 1265 microversion: 2.1 time: 0.149526 Oct 17 04:43:45.082310 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 512/1012] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:43:44 2022] GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:43:46.104334 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-7dc88122-7a61-4036-a90f-3490771dba27 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:43:46.104928 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-7dc88122-7a61-4036-a90f-3490771dba27 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:43:46.111480 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7dc88122-7a61-4036-a90f-3490771dba27 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:46.111957 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7dc88122-7a61-4036-a90f-3490771dba27 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:46.112390 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7dc88122-7a61-4036-a90f-3490771dba27 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:46.113066 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7dc88122-7a61-4036-a90f-3490771dba27 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:46.113537 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7dc88122-7a61-4036-a90f-3490771dba27 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:46.113956 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-7dc88122-7a61-4036-a90f-3490771dba27 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:46.246630 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-7dc88122-7a61-4036-a90f-3490771dba27 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:43:46.254278 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-7dc88122-7a61-4036-a90f-3490771dba27 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474" status: 200 len: 1265 microversion: 2.1 time: 0.153848 Oct 17 04:43:46.254842 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 501/1013] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:43:46 2022] GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:43:47.277268 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e261d740-b14a-40a9-9829-726b9a6eee3f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:43:47.277915 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e261d740-b14a-40a9-9829-726b9a6eee3f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:43:47.284295 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e261d740-b14a-40a9-9829-726b9a6eee3f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:47.284768 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e261d740-b14a-40a9-9829-726b9a6eee3f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:47.285222 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e261d740-b14a-40a9-9829-726b9a6eee3f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:47.285904 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e261d740-b14a-40a9-9829-726b9a6eee3f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:47.286350 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e261d740-b14a-40a9-9829-726b9a6eee3f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:47.286769 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e261d740-b14a-40a9-9829-726b9a6eee3f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:47.416619 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-e261d740-b14a-40a9-9829-726b9a6eee3f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:43:47.424934 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e261d740-b14a-40a9-9829-726b9a6eee3f tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474" status: 200 len: 1265 microversion: 2.1 time: 0.151548 Oct 17 04:43:47.425524 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 513/1014] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:43:47 2022] GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:43:48.448935 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=2 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:43:48.449652 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell0:SELECT=6 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:43:48.500571 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-700e36c3-a74a-4810-a339-cddd21522a44 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:43:48.501221 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-700e36c3-a74a-4810-a339-cddd21522a44 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:43:48.507105 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-700e36c3-a74a-4810-a339-cddd21522a44 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:48.507582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-700e36c3-a74a-4810-a339-cddd21522a44 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:48.508016 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-700e36c3-a74a-4810-a339-cddd21522a44 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:48.508700 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-700e36c3-a74a-4810-a339-cddd21522a44 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:48.509186 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-700e36c3-a74a-4810-a339-cddd21522a44 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:48.509622 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-700e36c3-a74a-4810-a339-cddd21522a44 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:48.644997 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-700e36c3-a74a-4810-a339-cddd21522a44 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:43:48.652801 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-700e36c3-a74a-4810-a339-cddd21522a44 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474" status: 200 len: 1265 microversion: 2.1 time: 0.208939 Oct 17 04:43:48.653454 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 502/1015] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:43:48 2022] GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:43:49.676375 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-bc46f25b-1b31-43cd-ae7a-839ac4286837 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:43:49.677151 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-bc46f25b-1b31-43cd-ae7a-839ac4286837 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:43:49.679415 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell0:SELECT=2 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:43:49.685163 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc46f25b-1b31-43cd-ae7a-839ac4286837 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:49.685576 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc46f25b-1b31-43cd-ae7a-839ac4286837 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:49.686012 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc46f25b-1b31-43cd-ae7a-839ac4286837 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:49.686720 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc46f25b-1b31-43cd-ae7a-839ac4286837 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:49.687188 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc46f25b-1b31-43cd-ae7a-839ac4286837 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:49.687608 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-bc46f25b-1b31-43cd-ae7a-839ac4286837 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:49.819607 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-bc46f25b-1b31-43cd-ae7a-839ac4286837 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:43:49.837690 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-bc46f25b-1b31-43cd-ae7a-839ac4286837 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474" status: 200 len: 1265 microversion: 2.1 time: 0.165107 Oct 17 04:43:49.838269 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 514/1016] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:43:49 2022] GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:43:50.861566 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3c33381d-fe76-4b03-8b30-7240e90c4fcc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:43:50.862183 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3c33381d-fe76-4b03-8b30-7240e90c4fcc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:43:50.868543 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c33381d-fe76-4b03-8b30-7240e90c4fcc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:50.869030 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c33381d-fe76-4b03-8b30-7240e90c4fcc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:50.869503 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c33381d-fe76-4b03-8b30-7240e90c4fcc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:50.870191 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c33381d-fe76-4b03-8b30-7240e90c4fcc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:50.870647 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c33381d-fe76-4b03-8b30-7240e90c4fcc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:50.871076 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3c33381d-fe76-4b03-8b30-7240e90c4fcc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:51.001960 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-3c33381d-fe76-4b03-8b30-7240e90c4fcc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:43:51.009582 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3c33381d-fe76-4b03-8b30-7240e90c4fcc tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474" status: 200 len: 1265 microversion: 2.1 time: 0.152694 Oct 17 04:43:51.010155 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 503/1017] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:43:50 2022] GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:43:51.757635 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-ddda6d17-0509-4e60-9bf5-dc5df56b5fc8 req-be46dfdd-47ef-4f01-81a8-59b409c5fdef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6c6596-e633-4406-983b-4074ea319474", "name": "network-vif-plugged", "status": "completed", "tag": "0525cf26-2cec-4fb2-8c7f-d4f1e0d418cf"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:43:51.768531 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ddda6d17-0509-4e60-9bf5-dc5df56b5fc8 req-be46dfdd-47ef-4f01-81a8-59b409c5fdef service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:51.769006 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ddda6d17-0509-4e60-9bf5-dc5df56b5fc8 req-be46dfdd-47ef-4f01-81a8-59b409c5fdef service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:51.769456 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-ddda6d17-0509-4e60-9bf5-dc5df56b5fc8 req-be46dfdd-47ef-4f01-81a8-59b409c5fdef service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:51.780616 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-ddda6d17-0509-4e60-9bf5-dc5df56b5fc8 req-be46dfdd-47ef-4f01-81a8-59b409c5fdef service nova] Creating event network-vif-plugged:0525cf26-2cec-4fb2-8c7f-d4f1e0d418cf for instance 5c6c6596-e633-4406-983b-4074ea319474 on hv-cinder-86155 Oct 17 04:43:51.785464 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-ddda6d17-0509-4e60-9bf5-dc5df56b5fc8 req-be46dfdd-47ef-4f01-81a8-59b409c5fdef service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031690 Oct 17 04:43:51.786044 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 515/1018] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:43:52.031919 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-80cbb0a7-36be-4da4-a168-87ed9102f0e9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:43:52.032535 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-80cbb0a7-36be-4da4-a168-87ed9102f0e9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:43:52.038954 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80cbb0a7-36be-4da4-a168-87ed9102f0e9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:52.039447 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80cbb0a7-36be-4da4-a168-87ed9102f0e9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:52.039887 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80cbb0a7-36be-4da4-a168-87ed9102f0e9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:52.040588 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80cbb0a7-36be-4da4-a168-87ed9102f0e9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:52.041048 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80cbb0a7-36be-4da4-a168-87ed9102f0e9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:52.041505 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-80cbb0a7-36be-4da4-a168-87ed9102f0e9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:52.171240 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-80cbb0a7-36be-4da4-a168-87ed9102f0e9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:43:52.178863 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-80cbb0a7-36be-4da4-a168-87ed9102f0e9 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474" status: 200 len: 1265 microversion: 2.1 time: 0.150950 Oct 17 04:43:52.179430 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 504/1019] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:43:52 2022] GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:43:53.203754 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-849992e8-1255-4bb4-a49d-25d61bdba409 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:43:53.204692 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-849992e8-1255-4bb4-a49d-25d61bdba409 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:43:53.210857 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-849992e8-1255-4bb4-a49d-25d61bdba409 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:53.211342 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-849992e8-1255-4bb4-a49d-25d61bdba409 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:53.211774 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-849992e8-1255-4bb4-a49d-25d61bdba409 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:53.212467 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-849992e8-1255-4bb4-a49d-25d61bdba409 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:53.212922 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-849992e8-1255-4bb4-a49d-25d61bdba409 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:53.213382 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-849992e8-1255-4bb4-a49d-25d61bdba409 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:53.346810 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-849992e8-1255-4bb4-a49d-25d61bdba409 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:43:53.355116 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-849992e8-1255-4bb4-a49d-25d61bdba409 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474" status: 200 len: 1452 microversion: 2.1 time: 0.156864 Oct 17 04:43:53.355672 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 516/1020] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:43:53 2022] GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:43:53.378587 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fe547241-99f7-4231-91d8-53ec919a887a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:43:53.379143 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fe547241-99f7-4231-91d8-53ec919a887a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:43:53.385865 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe547241-99f7-4231-91d8-53ec919a887a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:53.386355 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe547241-99f7-4231-91d8-53ec919a887a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:53.386800 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe547241-99f7-4231-91d8-53ec919a887a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:53.387501 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe547241-99f7-4231-91d8-53ec919a887a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:53.388672 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe547241-99f7-4231-91d8-53ec919a887a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:53.389133 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fe547241-99f7-4231-91d8-53ec919a887a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:53.519185 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-fe547241-99f7-4231-91d8-53ec919a887a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:43:53.526881 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fe547241-99f7-4231-91d8-53ec919a887a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474" status: 200 len: 1452 microversion: 2.1 time: 0.152851 Oct 17 04:43:53.527450 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 505/1021] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:43:53 2022] GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:43:55.075273 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-339bd775-bf7a-443d-bfa2-1a850ff8dec6 req-2c64c08d-47ba-4302-80f2-c769a938c49c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6c6596-e633-4406-983b-4074ea319474", "tag": "0525cf26-2cec-4fb2-8c7f-d4f1e0d418cf"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:43:55.085613 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-339bd775-bf7a-443d-bfa2-1a850ff8dec6 req-2c64c08d-47ba-4302-80f2-c769a938c49c service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:43:55.086142 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-339bd775-bf7a-443d-bfa2-1a850ff8dec6 req-2c64c08d-47ba-4302-80f2-c769a938c49c service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:43:55.086568 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-339bd775-bf7a-443d-bfa2-1a850ff8dec6 req-2c64c08d-47ba-4302-80f2-c769a938c49c service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:43:55.098256 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-339bd775-bf7a-443d-bfa2-1a850ff8dec6 req-2c64c08d-47ba-4302-80f2-c769a938c49c service nova] Creating event network-changed:0525cf26-2cec-4fb2-8c7f-d4f1e0d418cf for instance 5c6c6596-e633-4406-983b-4074ea319474 on hv-cinder-86155 Oct 17 04:43:55.103179 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-339bd775-bf7a-443d-bfa2-1a850ff8dec6 req-2c64c08d-47ba-4302-80f2-c769a938c49c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031554 Oct 17 04:43:55.104030 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 517/1022] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:45:25.507366 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_api:SELECT=20 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:45:25.508415 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG dbcounter [-] [119127] Writing DB stats nova_cell1:SELECT=40 {{(pid=119127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:45:25.508736 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-fec53a6b-46e3-452f-9daf-2efb8f41cfce tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:45:25.509475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fec53a6b-46e3-452f-9daf-2efb8f41cfce tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:45:25.510281 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 04:45:25.510412 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Mon Oct 17 04:45:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.40) !!! Oct 17 04:45:25.511677 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:45:25.512636 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG dbcounter [-] [119128] Writing DB stats nova_cell1:SELECT=46 {{(pid=119128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 04:45:25.514290 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 04:45:25.514841 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Mon Oct 17 04:45:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 (ip 10.222.0.40) !!! Oct 17 04:45:25.522076 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fec53a6b-46e3-452f-9daf-2efb8f41cfce tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:25.522566 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fec53a6b-46e3-452f-9daf-2efb8f41cfce tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:25.523207 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fec53a6b-46e3-452f-9daf-2efb8f41cfce tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:25.523910 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fec53a6b-46e3-452f-9daf-2efb8f41cfce tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:25.524599 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fec53a6b-46e3-452f-9daf-2efb8f41cfce tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:25.525558 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-fec53a6b-46e3-452f-9daf-2efb8f41cfce tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:25.555074 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-fec53a6b-46e3-452f-9daf-2efb8f41cfce tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:45:25.591255 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-2937befa-8ad8-488f-83e2-0cbb4919639c req-12ec5ee8-7a3a-4fd0-9867-5f28a4d31116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c6c6596-e633-4406-983b-4074ea319474", "tag": "0525cf26-2cec-4fb2-8c7f-d4f1e0d418cf"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:45:25.604360 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2937befa-8ad8-488f-83e2-0cbb4919639c req-12ec5ee8-7a3a-4fd0-9867-5f28a4d31116 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:25.604840 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2937befa-8ad8-488f-83e2-0cbb4919639c req-12ec5ee8-7a3a-4fd0-9867-5f28a4d31116 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:25.605316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2937befa-8ad8-488f-83e2-0cbb4919639c req-12ec5ee8-7a3a-4fd0-9867-5f28a4d31116 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:25.617448 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-2937befa-8ad8-488f-83e2-0cbb4919639c req-12ec5ee8-7a3a-4fd0-9867-5f28a4d31116 service nova] Creating event network-changed:0525cf26-2cec-4fb2-8c7f-d4f1e0d418cf for instance 5c6c6596-e633-4406-983b-4074ea319474 on hv-cinder-86155 Oct 17 04:45:25.623371 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-2937befa-8ad8-488f-83e2-0cbb4919639c req-12ec5ee8-7a3a-4fd0-9867-5f28a4d31116 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117420 Oct 17 04:45:25.624689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 518/1023] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:45:25.646046 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-fec53a6b-46e3-452f-9daf-2efb8f41cfce tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474" status: 204 len: 0 microversion: 2.1 time: 0.142663 Oct 17 04:45:25.648238 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 506/1024] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:45:25 2022] DELETE /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:45:25.657236 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-2f3437fa-6e10-43fc-92c2-fc3d1b19bf4a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:45:25.658104 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-2f3437fa-6e10-43fc-92c2-fc3d1b19bf4a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:45:25.664515 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f3437fa-6e10-43fc-92c2-fc3d1b19bf4a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:25.665014 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f3437fa-6e10-43fc-92c2-fc3d1b19bf4a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:25.665496 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f3437fa-6e10-43fc-92c2-fc3d1b19bf4a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:25.666206 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f3437fa-6e10-43fc-92c2-fc3d1b19bf4a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:25.666667 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f3437fa-6e10-43fc-92c2-fc3d1b19bf4a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:25.667104 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-2f3437fa-6e10-43fc-92c2-fc3d1b19bf4a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:25.801779 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-2f3437fa-6e10-43fc-92c2-fc3d1b19bf4a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:45:25.809589 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-2f3437fa-6e10-43fc-92c2-fc3d1b19bf4a tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474" status: 200 len: 1576 microversion: 2.1 time: 0.157524 Oct 17 04:45:25.810166 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 519/1025] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:45:25 2022] GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:45:26.833936 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-1e9cb020-a567-4b9f-be94-53c5657f8a2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:45:26.834646 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-1e9cb020-a567-4b9f-be94-53c5657f8a2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:45:26.841293 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e9cb020-a567-4b9f-be94-53c5657f8a2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:26.841774 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e9cb020-a567-4b9f-be94-53c5657f8a2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:26.842977 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e9cb020-a567-4b9f-be94-53c5657f8a2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:26.843693 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e9cb020-a567-4b9f-be94-53c5657f8a2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:26.844155 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e9cb020-a567-4b9f-be94-53c5657f8a2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:26.844581 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-1e9cb020-a567-4b9f-be94-53c5657f8a2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:26.975689 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-1e9cb020-a567-4b9f-be94-53c5657f8a2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:45:26.984071 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-1e9cb020-a567-4b9f-be94-53c5657f8a2b tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474" status: 200 len: 1576 microversion: 2.1 time: 0.154691 Oct 17 04:45:26.984638 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 507/1026] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:45:26 2022] GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:45:27.736444 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-2b12b06e-a252-45ea-9863-66c599965591 req-6c5595f3-6403-4eb6-b44d-e957b89a658b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c6c6596-e633-4406-983b-4074ea319474", "name": "network-vif-deleted", "tag": "0525cf26-2cec-4fb2-8c7f-d4f1e0d418cf"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:45:27.746329 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2b12b06e-a252-45ea-9863-66c599965591 req-6c5595f3-6403-4eb6-b44d-e957b89a658b service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:27.746739 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2b12b06e-a252-45ea-9863-66c599965591 req-6c5595f3-6403-4eb6-b44d-e957b89a658b service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:27.747169 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-2b12b06e-a252-45ea-9863-66c599965591 req-6c5595f3-6403-4eb6-b44d-e957b89a658b service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:27.759077 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-2b12b06e-a252-45ea-9863-66c599965591 req-6c5595f3-6403-4eb6-b44d-e957b89a658b service nova] Creating event network-vif-deleted:0525cf26-2cec-4fb2-8c7f-d4f1e0d418cf for instance 5c6c6596-e633-4406-983b-4074ea319474 on hv-cinder-86155 Oct 17 04:45:27.763833 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-2b12b06e-a252-45ea-9863-66c599965591 req-6c5595f3-6403-4eb6-b44d-e957b89a658b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031360 Oct 17 04:45:27.765316 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 520/1027] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:45:28.007075 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-ef676a39-1db3-4431-8869-675609136928 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:45:28.007687 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-ef676a39-1db3-4431-8869-675609136928 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:45:28.016316 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef676a39-1db3-4431-8869-675609136928 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:28.016809 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef676a39-1db3-4431-8869-675609136928 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:28.017307 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef676a39-1db3-4431-8869-675609136928 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:28.018016 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef676a39-1db3-4431-8869-675609136928 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:28.018471 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef676a39-1db3-4431-8869-675609136928 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:28.018899 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-ef676a39-1db3-4431-8869-675609136928 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:28.088759 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-ef676a39-1db3-4431-8869-675609136928 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:45:28.097610 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-ef676a39-1db3-4431-8869-675609136928 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474" status: 200 len: 1224 microversion: 2.1 time: 0.094237 Oct 17 04:45:28.098790 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 508/1028] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:45:28 2022] GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:45:29.123181 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-036f4eb5-e7cf-47c4-853d-c553b2956c13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:45:29.124399 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-036f4eb5-e7cf-47c4-853d-c553b2956c13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 5c6c6596-e633-4406-983b-4074ea319474] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:45:29.130614 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-036f4eb5-e7cf-47c4-853d-c553b2956c13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:29.131099 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-036f4eb5-e7cf-47c4-853d-c553b2956c13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:29.131538 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-036f4eb5-e7cf-47c4-853d-c553b2956c13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:29.132239 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-036f4eb5-e7cf-47c4-853d-c553b2956c13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:29.132689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-036f4eb5-e7cf-47c4-853d-c553b2956c13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:29.133133 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-036f4eb5-e7cf-47c4-853d-c553b2956c13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:29.147065 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-036f4eb5-e7cf-47c4-853d-c553b2956c13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] HTTP exception thrown: Instance 5c6c6596-e633-4406-983b-4074ea319474 could not be found. Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-036f4eb5-e7cf-47c4-853d-c553b2956c13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Request method failure captured: Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 HTTP/1.1 Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNxQz16mJalbzFqHX_tT1cAI9sWZFCod_CQ6WEeQjuarvXtUiew1yAjv1QzVt6gRIH_C7unAVyrlNibPYI_D44--M5yzc1-l5nC1G4npD0HO1t3mPNFEwg_Rnf8ijzyXKQnGNm9wrHjbbLeU7_Ql48XVOuJPOn1FbZcvAU6upG5Zxzg Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: 84d236da3b7b46f4ab13a096d7d80298 Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-TestVolumeBootPattern-593287949 Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:45:29.148689 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:45:29.150624 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:45:29.150624 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-TestVolumeBootPattern-593287949 Oct 17 04:45:29.150624 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: 84d236da3b7b46f4ab13a096d7d80298 Oct 17 04:45:29.150624 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestVolumeBootPattern-593287949 Oct 17 04:45:29.150624 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-TestVolumeBootPattern-593287949-project Oct 17 04:45:29.150624 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:45:29.150624 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:45:29.150624 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 2ed9c2a1827b4fc5a916092b30bdec15 Oct 17 04:45:29.150624 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-TestVolumeBootPattern-593287949-project Oct 17 04:45:29.150624 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:45:29.150624 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance 5c6c6596-e633-4406-983b-4074ea319474 could not be found. Oct 17 04:45:29.150624 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': '5c6c6596-e633-4406-983b-4074ea319474'} Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c6c6596-e633-4406-983b-4074ea319474 could not be found. Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:45:29.151643 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:45:29.153423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:45:29.153423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:45:29.153423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:45:29.153423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:45:29.153423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:45:29.153423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:45:29.153423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:45:29.153423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c6c6596-e633-4406-983b-4074ea319474 could not be found. Oct 17 04:45:29.153423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:45:29.153423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:45:29.153423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:45:29.153423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:45:29.153423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:45:29.153423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:45:29.153423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:45:29.153423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:45:29.153423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c6c6596-e633-4406-983b-4074ea319474 could not be found. Oct 17 04:45:29.153423 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:45:29.154983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-036f4eb5-e7cf-47c4-853d-c553b2956c13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Returning 404 to user: Instance 5c6c6596-e633-4406-983b-4074ea319474 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:45:29.154983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-036f4eb5-e7cf-47c4-853d-c553b2956c13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474" status: 404 len: 111 microversion: 2.1 time: 0.031664 Oct 17 04:45:29.154983 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 521/1029] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:45:29 2022] GET /compute/v2.1/servers/5c6c6596-e633-4406-983b-4074ea319474 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:45:32.188284 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-3dae2b7f-fc71-4e42-a4d1-2b3d27a3b89d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:45:32.188796 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3dae2b7f-fc71-4e42-a4d1-2b3d27a3b89d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:45:32.195496 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3dae2b7f-fc71-4e42-a4d1-2b3d27a3b89d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:32.196178 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3dae2b7f-fc71-4e42-a4d1-2b3d27a3b89d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:32.196600 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-41128d6d-c588-4903-a149-034365174d7f req-4a7e4346-3c86-47cf-8d7f-cc64ce819ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ce3a7c3-014e-41c8-a901-fa08552d42ec", "tag": "7e8c740c-1878-4832-8274-c7a791c5836b"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:45:32.197024 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3dae2b7f-fc71-4e42-a4d1-2b3d27a3b89d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:32.197533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3dae2b7f-fc71-4e42-a4d1-2b3d27a3b89d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:32.198104 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3dae2b7f-fc71-4e42-a4d1-2b3d27a3b89d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:32.198722 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-3dae2b7f-fc71-4e42-a4d1-2b3d27a3b89d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:32.206841 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-41128d6d-c588-4903-a149-034365174d7f req-4a7e4346-3c86-47cf-8d7f-cc64ce819ca1 service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:32.207313 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-41128d6d-c588-4903-a149-034365174d7f req-4a7e4346-3c86-47cf-8d7f-cc64ce819ca1 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:32.207735 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-41128d6d-c588-4903-a149-034365174d7f req-4a7e4346-3c86-47cf-8d7f-cc64ce819ca1 service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:32.218906 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-41128d6d-c588-4903-a149-034365174d7f req-4a7e4346-3c86-47cf-8d7f-cc64ce819ca1 service nova] Creating event network-changed:7e8c740c-1878-4832-8274-c7a791c5836b for instance 2ce3a7c3-014e-41c8-a901-fa08552d42ec on hv-cinder-86155 Oct 17 04:45:32.224366 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-41128d6d-c588-4903-a149-034365174d7f req-4a7e4346-3c86-47cf-8d7f-cc64ce819ca1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031176 Oct 17 04:45:32.225043 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 522/1030] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:45:32.226488 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-3dae2b7f-fc71-4e42-a4d1-2b3d27a3b89d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Going to try to terminate instance {{(pid=119128) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 04:45:32.312841 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-3dae2b7f-fc71-4e42-a4d1-2b3d27a3b89d tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 204 len: 0 microversion: 2.1 time: 0.128625 Oct 17 04:45:32.314158 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 509/1031] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:45:32 2022] DELETE /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 04:45:32.322409 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-3429b05f-af72-40f7-b832-d0f97631d263 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:45:32.323540 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-3429b05f-af72-40f7-b832-d0f97631d263 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:45:32.330718 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3429b05f-af72-40f7-b832-d0f97631d263 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:32.331330 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3429b05f-af72-40f7-b832-d0f97631d263 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:32.331926 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3429b05f-af72-40f7-b832-d0f97631d263 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:32.332933 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3429b05f-af72-40f7-b832-d0f97631d263 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:32.333629 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3429b05f-af72-40f7-b832-d0f97631d263 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:32.334121 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-3429b05f-af72-40f7-b832-d0f97631d263 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:32.474111 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.policy [None req-3429b05f-af72-40f7-b832-d0f97631d263 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119127) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:45:32.482302 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-3429b05f-af72-40f7-b832-d0f97631d263 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 200 len: 1578 microversion: 2.1 time: 0.164172 Oct 17 04:45:32.483534 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 523/1032] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:45:32 2022] GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:45:33.508080 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2893adef-4a0a-467f-9f80-b5cc9a44957c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:45:33.515304 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2893adef-4a0a-467f-9f80-b5cc9a44957c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:45:33.524300 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2893adef-4a0a-467f-9f80-b5cc9a44957c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:33.524794 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2893adef-4a0a-467f-9f80-b5cc9a44957c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:33.526138 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2893adef-4a0a-467f-9f80-b5cc9a44957c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:33.526138 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2893adef-4a0a-467f-9f80-b5cc9a44957c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:33.527397 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2893adef-4a0a-467f-9f80-b5cc9a44957c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:33.528035 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2893adef-4a0a-467f-9f80-b5cc9a44957c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:33.672008 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-2893adef-4a0a-467f-9f80-b5cc9a44957c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:45:33.679781 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2893adef-4a0a-467f-9f80-b5cc9a44957c tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 200 len: 1578 microversion: 2.1 time: 0.175882 Oct 17 04:45:33.680279 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 510/1033] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:45:33 2022] GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:45:34.232073 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [req-08476553-8ae8-488e-afbf-af528b668efe req-60f234f8-9219-4b1a-8922-57d81b04f22b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce3a7c3-014e-41c8-a901-fa08552d42ec", "name": "network-vif-deleted", "tag": "7e8c740c-1878-4832-8274-c7a791c5836b"}]} {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 04:45:34.243380 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-08476553-8ae8-488e-afbf-af528b668efe req-60f234f8-9219-4b1a-8922-57d81b04f22b service nova] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:34.243864 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-08476553-8ae8-488e-afbf-af528b668efe req-60f234f8-9219-4b1a-8922-57d81b04f22b service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:34.244399 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [req-08476553-8ae8-488e-afbf-af528b668efe req-60f234f8-9219-4b1a-8922-57d81b04f22b service nova] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:34.257511 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.compute.server_external_events [req-08476553-8ae8-488e-afbf-af528b668efe req-60f234f8-9219-4b1a-8922-57d81b04f22b service nova] Creating event network-vif-deleted:7e8c740c-1878-4832-8274-c7a791c5836b for instance 2ce3a7c3-014e-41c8-a901-fa08552d42ec on hv-cinder-86155 Oct 17 04:45:34.262160 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [req-08476553-8ae8-488e-afbf-af528b668efe req-60f234f8-9219-4b1a-8922-57d81b04f22b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033837 Oct 17 04:45:34.262746 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 524/1034] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Oct 17 04:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 04:45:34.703628 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-5583bcdb-0f3f-4471-ab13-7c852032ef13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:45:34.704251 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-5583bcdb-0f3f-4471-ab13-7c852032ef13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:45:34.710908 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5583bcdb-0f3f-4471-ab13-7c852032ef13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:34.711398 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5583bcdb-0f3f-4471-ab13-7c852032ef13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:34.711842 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5583bcdb-0f3f-4471-ab13-7c852032ef13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:34.712538 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5583bcdb-0f3f-4471-ab13-7c852032ef13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:34.712997 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5583bcdb-0f3f-4471-ab13-7c852032ef13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:34.713461 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5583bcdb-0f3f-4471-ab13-7c852032ef13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:34.743992 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5583bcdb-0f3f-4471-ab13-7c852032ef13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:34.744471 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5583bcdb-0f3f-4471-ab13-7c852032ef13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:34.744931 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-5583bcdb-0f3f-4471-ab13-7c852032ef13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:34.745400 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.objects.instance [None req-5583bcdb-0f3f-4471-ab13-7c852032ef13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lazy-loading 'fault' on Instance uuid 2ce3a7c3-014e-41c8-a901-fa08552d42ec {{(pid=119128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 04:45:34.787856 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.policy [None req-5583bcdb-0f3f-4471-ab13-7c852032ef13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed9c2a1827b4fc5a916092b30bdec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d236da3b7b46f4ab13a096d7d80298', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119128) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 04:45:34.796449 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-5583bcdb-0f3f-4471-ab13-7c852032ef13 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 200 len: 1230 microversion: 2.1 time: 0.096735 Oct 17 04:45:34.797023 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 511/1035] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:45:34 2022] GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 04:45:35.821590 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e35eca08-f718-4816-847f-889880430938 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:45:35.822288 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e35eca08-f718-4816-847f-889880430938 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: 2ce3a7c3-014e-41c8-a901-fa08552d42ec] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:45:35.828589 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e35eca08-f718-4816-847f-889880430938 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:35.829067 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e35eca08-f718-4816-847f-889880430938 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:35.829520 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e35eca08-f718-4816-847f-889880430938 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:35.830536 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e35eca08-f718-4816-847f-889880430938 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:35.830922 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e35eca08-f718-4816-847f-889880430938 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:35.831345 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e35eca08-f718-4816-847f-889880430938 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:35.844680 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e35eca08-f718-4816-847f-889880430938 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] HTTP exception thrown: Instance 2ce3a7c3-014e-41c8-a901-fa08552d42ec could not be found. Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e35eca08-f718-4816-847f-889880430938 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Request method failure captured: Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec HTTP/1.1 Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNxQz16mJalbzFqHX_tT1cAI9sWZFCod_CQ6WEeQjuarvXtUiew1yAjv1QzVt6gRIH_C7unAVyrlNibPYI_D44--M5yzc1-l5nC1G4npD0HO1t3mPNFEwg_Rnf8ijzyXKQnGNm9wrHjbbLeU7_Ql48XVOuJPOn1FbZcvAU6upG5Zxzg Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: 84d236da3b7b46f4ab13a096d7d80298 Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-TestVolumeBootPattern-593287949 Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:45:35.846305 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:45:35.848016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:45:35.848016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-TestVolumeBootPattern-593287949 Oct 17 04:45:35.848016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: 84d236da3b7b46f4ab13a096d7d80298 Oct 17 04:45:35.848016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestVolumeBootPattern-593287949 Oct 17 04:45:35.848016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-TestVolumeBootPattern-593287949-project Oct 17 04:45:35.848016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:45:35.848016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:45:35.848016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 2ed9c2a1827b4fc5a916092b30bdec15 Oct 17 04:45:35.848016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-TestVolumeBootPattern-593287949-project Oct 17 04:45:35.848016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:45:35.848016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance 2ce3a7c3-014e-41c8-a901-fa08552d42ec could not be found. Oct 17 04:45:35.848016 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': '2ce3a7c3-014e-41c8-a901-fa08552d42ec'} Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ce3a7c3-014e-41c8-a901-fa08552d42ec could not be found. Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:45:35.848991 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:45:35.850727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:45:35.850727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:45:35.850727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:45:35.850727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:45:35.850727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:45:35.850727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:45:35.850727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:45:35.850727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ce3a7c3-014e-41c8-a901-fa08552d42ec could not be found. Oct 17 04:45:35.850727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:45:35.850727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:45:35.850727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:45:35.850727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:45:35.850727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:45:35.850727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:45:35.850727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:45:35.850727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:45:35.850727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ce3a7c3-014e-41c8-a901-fa08552d42ec could not be found. Oct 17 04:45:35.850727 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:45:35.852301 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e35eca08-f718-4816-847f-889880430938 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Returning 404 to user: Instance 2ce3a7c3-014e-41c8-a901-fa08552d42ec could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:45:35.852301 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e35eca08-f718-4816-847f-889880430938 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec" status: 404 len: 111 microversion: 2.1 time: 0.030926 Oct 17 04:45:35.852301 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 525/1036] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:45:35 2022] GET /compute/v2.1/servers/2ce3a7c3-014e-41c8-a901-fa08552d42ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:45:36.287901 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a2c3316-2cbf-4130-9362-dbf473d145c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:45:36.288708 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.compute.api [None req-2a2c3316-2cbf-4130-9362-dbf473d145c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119128) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:45:36.296533 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a2c3316-2cbf-4130-9362-dbf473d145c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:36.297135 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a2c3316-2cbf-4130-9362-dbf473d145c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:36.297655 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a2c3316-2cbf-4130-9362-dbf473d145c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:36.298487 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a2c3316-2cbf-4130-9362-dbf473d145c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:36.299209 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a2c3316-2cbf-4130-9362-dbf473d145c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:36.299694 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG oslo_concurrency.lockutils [None req-2a2c3316-2cbf-4130-9362-dbf473d145c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:36.315026 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.wsgi [None req-2a2c3316-2cbf-4130-9362-dbf473d145c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] HTTP exception thrown: Instance ed045a1c-3978-4818-8ea0-9ee3711acd79 could not be found. Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a2c3316-2cbf-4130-9362-dbf473d145c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Request method failure captured: Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: request: DELETE /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 HTTP/1.1 Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept: application/json Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Accept-Encoding: identity Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Connection: close Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Length: 0 Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Content-Type: application/json Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Host: 10.222.0.40 Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: Openstack-System-Scope: None Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: User-Agent: python-urllib3/1.26.12 Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Auth-Token: gAAAAABjTNxQz16mJalbzFqHX_tT1cAI9sWZFCod_CQ6WEeQjuarvXtUiew1yAjv1QzVt6gRIH_C7unAVyrlNibPYI_D44--M5yzc1-l5nC1G4npD0HO1t3mPNFEwg_Rnf8ijzyXKQnGNm9wrHjbbLeU7_Ql48XVOuJPOn1FbZcvAU6upG5Zxzg Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Id: None Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Domain-Name: None Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Identity-Status: Confirmed Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Is-Admin-Project: True Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Id: default Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Domain-Name: Default Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Id: 84d236da3b7b46f4ab13a096d7d80298 Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Project-Name: tempest-TestVolumeBootPattern-593287949 Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Role: reader,member Oct 17 04:45:36.316705 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Roles: reader,member Oct 17 04:45:36.318475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:45:36.318475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant: tempest-TestVolumeBootPattern-593287949 Oct 17 04:45:36.318475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Id: 84d236da3b7b46f4ab13a096d7d80298 Oct 17 04:45:36.318475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-Tenant-Name: tempest-TestVolumeBootPattern-593287949 Oct 17 04:45:36.318475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User: tempest-TestVolumeBootPattern-593287949-project Oct 17 04:45:36.318475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Id: default Oct 17 04:45:36.318475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Domain-Name: Default Oct 17 04:45:36.318475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Id: 2ed9c2a1827b4fc5a916092b30bdec15 Oct 17 04:45:36.318475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: X-User-Name: tempest-TestVolumeBootPattern-593287949-project Oct 17 04:45:36.318475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: method: > Oct 17 04:45:36.318475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: exception: Instance ed045a1c-3978-4818-8ea0-9ee3711acd79 could not be found. Oct 17 04:45:36.318475 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: action_args: {'id': 'ed045a1c-3978-4818-8ea0-9ee3711acd79'} Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed045a1c-3978-4818-8ea0-9ee3711acd79 could not be found. Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:45:36.319436 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed045a1c-3978-4818-8ea0-9ee3711acd79 could not be found. Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed045a1c-3978-4818-8ea0-9ee3711acd79 could not be found. Oct 17 04:45:36.321168 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: ERROR nova.api.openstack.wsgi Oct 17 04:45:36.322937 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-2a2c3316-2cbf-4130-9362-dbf473d145c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Returning 404 to user: Instance ed045a1c-3978-4818-8ea0-9ee3711acd79 could not be found. {{(pid=119128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:45:36.322937 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-2a2c3316-2cbf-4130-9362-dbf473d145c0 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 404 len: 111 microversion: 2.1 time: 0.034587 Oct 17 04:45:36.322937 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 512/1037] 10.222.0.40 () {58 vars in 1239 bytes} [Mon Oct 17 04:45:36 2022] DELETE /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:45:36.327050 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e3cdfcf1-6aa2-4e19-af51-4f33a0f6bdf2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '>' {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:45:36.327682 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.compute.api [None req-e3cdfcf1-6aa2-4e19-af51-4f33a0f6bdf2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] [instance: ed045a1c-3978-4818-8ea0-9ee3711acd79] Fetching instance by UUID {{(pid=119127) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 04:45:36.333820 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3cdfcf1-6aa2-4e19-af51-4f33a0f6bdf2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:36.334298 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3cdfcf1-6aa2-4e19-af51-4f33a0f6bdf2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:36.334751 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3cdfcf1-6aa2-4e19-af51-4f33a0f6bdf2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:36.335422 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3cdfcf1-6aa2-4e19-af51-4f33a0f6bdf2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Acquiring lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 04:45:36.335874 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3cdfcf1-6aa2-4e19-af51-4f33a0f6bdf2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 04:45:36.336298 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG oslo_concurrency.lockutils [None req-e3cdfcf1-6aa2-4e19-af51-4f33a0f6bdf2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Lock "bfb5b667-bbe0-47ae-a932-3b61872d8f9d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 04:45:36.349429 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.wsgi [None req-e3cdfcf1-6aa2-4e19-af51-4f33a0f6bdf2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] HTTP exception thrown: Instance ed045a1c-3978-4818-8ea0-9ee3711acd79 could not be found. Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e3cdfcf1-6aa2-4e19-af51-4f33a0f6bdf2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Request method failure captured: Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: request: GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 HTTP/1.1 Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept: application/json Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Accept-Encoding: identity Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Connection: close Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Length: 0 Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Content-Type: application/json Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Host: 10.222.0.40 Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: Openstack-System-Scope: None Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: User-Agent: python-urllib3/1.26.12 Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Auth-Token: gAAAAABjTNxQz16mJalbzFqHX_tT1cAI9sWZFCod_CQ6WEeQjuarvXtUiew1yAjv1QzVt6gRIH_C7unAVyrlNibPYI_D44--M5yzc1-l5nC1G4npD0HO1t3mPNFEwg_Rnf8ijzyXKQnGNm9wrHjbbLeU7_Ql48XVOuJPOn1FbZcvAU6upG5Zxzg Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Id: None Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Domain-Name: None Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Identity-Status: Confirmed Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Is-Admin-Project: True Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Id: default Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Domain-Name: Default Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Id: 84d236da3b7b46f4ab13a096d7d80298 Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Project-Name: tempest-TestVolumeBootPattern-593287949 Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Role: reader,member Oct 17 04:45:36.350941 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Roles: reader,member Oct 17 04:45:36.352736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84d236da3b7b46f4ab13a096d7d80298"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/networking"}]}] Oct 17 04:45:36.352736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant: tempest-TestVolumeBootPattern-593287949 Oct 17 04:45:36.352736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Id: 84d236da3b7b46f4ab13a096d7d80298 Oct 17 04:45:36.352736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-Tenant-Name: tempest-TestVolumeBootPattern-593287949 Oct 17 04:45:36.352736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User: tempest-TestVolumeBootPattern-593287949-project Oct 17 04:45:36.352736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Id: default Oct 17 04:45:36.352736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Domain-Name: Default Oct 17 04:45:36.352736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Id: 2ed9c2a1827b4fc5a916092b30bdec15 Oct 17 04:45:36.352736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: X-User-Name: tempest-TestVolumeBootPattern-593287949-project Oct 17 04:45:36.352736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: method: > Oct 17 04:45:36.352736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: exception: Instance ed045a1c-3978-4818-8ea0-9ee3711acd79 could not be found. Oct 17 04:45:36.352736 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: action_args: {'id': 'ed045a1c-3978-4818-8ea0-9ee3711acd79'} Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: {{(pid=119127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed045a1c-3978-4818-8ea0-9ee3711acd79 could not be found. Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 04:45:36.353744 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 04:45:36.355487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 04:45:36.355487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 04:45:36.355487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 04:45:36.355487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 04:45:36.355487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 04:45:36.355487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 04:45:36.355487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 04:45:36.355487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed045a1c-3978-4818-8ea0-9ee3711acd79 could not be found. Oct 17 04:45:36.355487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:45:36.355487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 04:45:36.355487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:45:36.355487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 04:45:36.355487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 04:45:36.355487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 04:45:36.355487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 04:45:36.355487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 04:45:36.355487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed045a1c-3978-4818-8ea0-9ee3711acd79 could not be found. Oct 17 04:45:36.355487 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: ERROR nova.api.openstack.wsgi Oct 17 04:45:36.357046 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: DEBUG nova.api.openstack.wsgi [None req-e3cdfcf1-6aa2-4e19-af51-4f33a0f6bdf2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Returning 404 to user: Instance ed045a1c-3978-4818-8ea0-9ee3711acd79 could not be found. {{(pid=119127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 04:45:36.357046 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: INFO nova.api.openstack.requestlog [None req-e3cdfcf1-6aa2-4e19-af51-4f33a0f6bdf2 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79" status: 404 len: 111 microversion: 2.1 time: 0.029258 Oct 17 04:45:36.357046 dv-cinder-861557-1-iscsi devstack@n-api.service[119127]: [pid: 119127|app: 0|req: 526/1038] 10.222.0.40 () {58 vars in 1236 bytes} [Mon Oct 17 04:45:36 2022] GET /compute/v2.1/servers/ed045a1c-3978-4818-8ea0-9ee3711acd79 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 04:45:37.651703 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: DEBUG nova.api.openstack.wsgi [None req-80962af2-d427-4494-b8e0-50f94a3efb89 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] Calling method '.version_select at 0x7fc630ee4040>' {{(pid=119128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 04:45:37.686959 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: INFO nova.api.openstack.requestlog [None req-80962af2-d427-4494-b8e0-50f94a3efb89 tempest-TestVolumeBootPattern-593287949 tempest-TestVolumeBootPattern-593287949-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-118990177" status: 202 len: 0 microversion: 2.1 time: 0.039083 Oct 17 04:45:37.687594 dv-cinder-861557-1-iscsi devstack@n-api.service[119128]: [pid: 119128|app: 0|req: 513/1039] 10.222.0.40 () {58 vars in 1260 bytes} [Mon Oct 17 04:45:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-118990177 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)